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INTRODUCTIOPf 



Project Developmental eonti nu i ty (PDC) was begun in 197^ by the 
Admiriistratldn for Children, Yoath and Rami 1 ies (ACYF) as the first large- 
scale demonstration of coordinated programming between Read Start centers 
and pub] ic\schobl s iri 15 communities throughout the country allocated by 
HEW regibris^^nd the Indian and Migrant Program Divi slon. jt is hoped that 
the single most important effectof this undertaking will be to enhance 
the social competence of the chi Idren served--that is, to i ncrease the[r 
everyday effectiveness in dealing wi th the] r_ehy 1 rorirrient (at school, at , 
home. In the community, and in society) . _ PDC also aims to bring about 
broader and more intensive involvement of parents and teachers in the 
goverharice of school affairs. 

As. part of the overall Head Start improvement and [nnovation effort, 
PDC emphasizes the involvement of adminiistrators, classroom staff , and 
parents in formulating educational goals arid- develop! ng a comprehensive 

curriculum. The object Is to e,isure that children receive continuous 

individual ized attention as they progress from Head Start throtjgh the early 
primary grades. If the program j s successful , exi st I ng_ d i scon tinu it i es 
between Head Start and elementary schoo| experiences wi 11 be^redUced by 
PDC mechanisms that encourage communicating and mutual dec? sIoh-maHIng 
among preschool and elementary school teachers, administrators, and parents. 

School organizations at the 15 sites received funding to design and 
Implement seven prescribed components: 

• Admi nlstrat io n: administrative coordination between and within 
Head Start and elementary school ; 

• Education: coordination of curriculum approaches. and educational 
goal s ; 

m Training : preservice and Inservice teacher, staff and parent 
train I ng In program-related areas; 

0 Developmental support services : . comprehensive services (medical, 
nutritional, and social) to children and farrilliiss; 

• Parent Iriv olvemen^ : parent participation in policy-making, home- 
school activities, and classroom visits or volunteering; 

• Services fo r the handicapped : services for handicapped children 
and children with learning disabilities; 

• Bl-l-Migual/blcnl t-^r^l and multicultural education : programs for 
bil ingual/bi cul tur^al or multicultural children. 



At_the samietime that projects wbre i ns t i tu Led ; the High/Scope Educa- 
tlbrial Research Fbuhdatidh was awarded the ieva 1 uat Ion contract; the major 
purpose of which was to jprdvide AL.'F with 1 rifbrmat ion that would assist 
It iri Its efforts to design effective programs for childrien. Thie contract 
calied for the collection and analysis of process and impact data involving 
both quantitative and qualitative methodologies. 

The evaluation has proceeded two phases. From 197^ to 1978 evaluation 
activities were aimed at analyzing program imp! ementat Ion and assessing the 
feasibi 1 [ty of doing a five-year longitudinal study that would fo[low one 
cohort of children from the time they entered Head Start unt i 1 they completed 
third grade. ^ After judging _ the study feasible, ACYF funded the current 
phase of the evaluation (1979*1982) to examine the impact of PDC on parti- 
cipating institutions, teachers and classrooms, parents and children in 
eleven of the twelve sites :Sti11 participating in the project. 

This volume, ' Impact on Children; is the f[fth of a series reporting 
impact _ findings as of spring of the study cohort -chj-J-dre p ' 5 first-grade 
year ( « 979) - Other volumes in the series inci ude: 

• Volume i. Assessment o.f Program Impact Through F i rs^-G-rade^ — the 
Context, Conceptual Approaches and Methods of the PDC Eva I uat ion , 
Serves as an introduction, providing a detailed description of 
the PDC program and the purposes; methods and guiding framework 
of the impact evaluation. 

i Volume. i I Impact gn I nst i tut ions - Describes findings deal ing 

specifically with PDC's impact on the i ns t i tu 1 1 onal policies 

and procedures of participating Head Start centers and elementary 
schools. These fIndi^gs are pres.ented in the context of the 
varied social edDcational settings surrounding PDC. 

• Volume II 1^ 4mfiact on Parents , Investigates the impact of PDC 
on the parents of children in the evaluation cohort and, in a 
prel irr^inary fashion, the relationship between family charac- 
teristics and outcome variables. 

• Volum e iV, Impact on Teachers , Reports Impact fi ndings on 
Teachers and classioom;. These impacts reflect treatment-related 
cutcomes as ^:cl 1 as outcomes regardless of treatment. 



^The results of. this phase of the eval uat ion are descr i bed I n : bove^ Granville 
and Smith, 1978; and. Smith, Love, Morris, Spencer, Ispa and Ros^rlo, 
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9 Volume Vi, Sammary of impact on j nst i tut Ibris , Teachers arid 
Classrooms, Parents and Childrea; Summarizes the evaluation 
results- for 1979, when the cohort of children be[ngstad|ed In 
the evaluation had completed grade t . Resut ts are presented 
for each of the fc jr ma jor areas: Institutional pot icies and 
. procedures, teacher attitudes arid bishaviors In the classroom 
and with parents, parent attitudes arid behaviors Iri relatlori 
to their child's school, and the achievement of chl Idreri. Iri 
addition, the vblame /sdnHnarlzes the Iriitial analyses of iriter- 
retatlonshlps between'^the four major areas, such as the relatlbri- 
shlp between teacher attitudes and parent behaviors concerning 
Irivdlvemerit with their child's school. 

This volume _repbrts on the impact of the PDC program on the evaluation 
study's cohort of children. Itis organized into five major sections, 
plus a summary and two technical appendices.. This chapter preserits a 
brief history of the PD6 prbgfam and its evaluation. 

Chapter jl describes the conceptual framework guiding the study of 
PDC processesarid effects on chi 1 dren . This framework has made it possible 
for us to begin to "model", the concept of Project Devetopmentat Continuity 
as well as the kinds and directions of changes necessary for its institu- 
tionalization. It is presented as two differerit "models": a c oncept u al 
model that describes Ideally the intended effects of PDC^ arid ari analyt-lc 
modeT that describes operat ibnalLy the change flow. expected aad required 
to bring about the intended effects. Chapter II also describes the butcome 
measures that are used to assess the children's performance, and how these 
measures fit iritb the coriceptuat and analytic models. 

The data collectlori and arialysis procedures required by a study of 

this magnitude and complexity .are discussed in Chapter Ml. under the . 

general title of "Methods." Chapter IV preserits the descriptive findings 
regarding the sample and the characteristics of the iristrumerits. Chapter 
V describes the results of the child outcome measures Irialyses. Iri Chapter 
VI, we* summarize the major findings and discuss implications for the future. 




II 

A FRAMEWORK FOR STUDYING PDC PROeESSES AND EFFEeTS OK CHILDREN 

the evaluation has been largely shaped By a particular conceotTon^ 
(ferived ffont the PDC guidelines, of the inrenced effects of PDC and the 
s«;uerice of changes exoected and reculred to or^^S^o?^ 
Before describing the design and methdddSogy of the eval uat Ion , we w[l 1^ 
in this section attempt to make this conceptual frarnework nore expliclt- 
Tfeis discussion has three parts. In the first tv«, we j? resent a general _ 
model of the intended effects of PDC, along with a cbnsideratibh df-tfie 
FDC "treatment" and how, as described in the guldel inesTIt was intended 
to produce the desired effects. In the third part we describe the process 
aiat was used to nove from the basic frameworjc to the specification bf^ 
particular variables and appropriate data collection instruments for this 
phase of the evaluation. • 



Some Orienting Assumptions: The C oncept of Developme ntal Continuity 

the basic assurrptibn underlying the PDC program and consequently this 
evaluation is that the condition of developmental continuity _ impl les a 
cbinplex interaction involving an array of factors, both within and o^JtsIde 
the school. As a result of this assumption, PSC was designed to be a 
ramprehensive Intervention into many aspects of the school, home and 

coniminity. However, although the implications of this basic assumption . 

pervade the program, the PDC guidelines never fully expl icate th! s assumption. 

In brder_tp design an evaluation that is sensitive to the particular* 
"goals of the PDC program it was necessary to distiU f rom the guide 1 ihes 
Se concept of developmental _ con ti flu I ty that appears to have shaped program 
guidelines. Figure 1 surranarizes the results of this exercise. We must 
cinphasize that this cbnceptuaMzat Ion Ts not at present a theory to be 
tested by the data. Rather, it represents an orienting framework that Has 
provided a basis for generating an 3na|yt|c model, out of which have cone 
research questions, variables, and data collection methodologies, ^e have 
used this orienting fr^mev#drk to guide the analysis and reporting of evalt:a- 
tion data. 

" ' ^ * - - - . . — 

simply stated, the conception of develbpnental continuity implicit 
in PDC suggests an interactionaL mbde^ that appears to include: (a) a 
child's intellectual, social, and physical deveioDmeht and background 
ind experiences in home and school; (b) the attitudes, knowledge and back- 
ground characteristics of parents and teachers; fc) the pbUcies and proce- 
dures-that prevail in the public school dr Head Start center; and, (d) the 
broader political, social and economic context of the school district and 
OORinunity. 
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Figure 1 - - — - 

The Conception of Devejopnienta! Eont]nu|ty Assumed In PDC 
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_ We will return later to cpnslderatibh ipf how each of the classes of 
factors in Figure I was defined bberat ibnal ly for this evaluation^ and 
of %rfhat variaoles were neasured in each domain. For the mcaSeht^ fcwever^ 
the foilowinc general definitions will suffice: 

m Child developnept oatcones > These, of course, are the ultinste 
concern of ine PZ-Z Drc§ram. The stated goal of PDC is to enhance 
children*s '^social corrpetency According to the guidelines^ 
social competence includes intellectual achievement, health and 
nutrition, social -errotional and language developraent:^ physical 
and mental health, and learning attitudes. 



:# Parent behaviors - This ddnain includes parent behaviors 
toward the chi Id in the home, ^hd the role that the [parent 
plays in school life. 

• Parent- attitudes and knowled ge. EsDecially important in this 
domain are parent att i tcce^ toward the school or center 

and parent knowledge of child develbiiHTEnt and available UJirwiuri i ty 
resources. 

• Teacher. be&av_lors_and_ classroom activities . Tnis dcairain refers to 
the child* 5 experiences in the classroom and to the role of the 
teacher in these experiences- It Includes the physical environment 
that theteacher creates fbr the child in the classroom, the 
ihstructibnal aoproach that the teacher employs , the management 
style of the teacher in his/her dealings with the class^ and the 
general climate that the teacher establishes in the classroom for 
the chi Idren. 

• Teacher attitudes . A broad and of ten-noted domain in the program 
guidelines, tnis categbry refers tb teachers' instructional practices 
and their perceptions of, and attitudes toward parents, particularly _ 
parent invblvemeht in their classrooms, and their personal educational 
phi losophy. 

• instlrut ional ooWcies and Drocedures^ . This domain includes the 
activities anc prbcecures that are found outside the classroom, 
but which i rif 1 uerice what goes oh in the classroom. Such policies 
and procedures include the decisibn-makinc bodies and mechanisms 
that exist in ihe school, tne management structure found in the 
school, procecares for providing services ro children either insid*- 
or outside the classroom, patterns of communication and coordina- 
tion in the school and between the school and other institutions, 
and training that the schbbl provides for teaj^hers, parents, and 
Staff. 

• gortiTmhlty: and educaribnal -ccntext^ "^?^b schbbl br family exists 

in a vacuum. The program gui;a^lnes recognize that everything that 
occurs in either settU^g-^-f^shaped and on occasion constrained by 
culturaj, po^liticetT''^d economic factors in the consnunity, and by 
priorities,^ policies, and programs of the school district. Another 
Important feature bf the commun ity_ con text is the services for 
families and. children that are available frbrri agencies outside the 
school i 

7 t 



ERIC 



• Child and family bickr^nng ; Althodgn not generally susceptTble 
to change &y scnool pragrcms, tne background of tne * ^ 

or her family are '-ecognlzed In me guidelines to be imoortant 
deterrninants of develcsmeht- This dctnain incluaes sucn factors 
as ethnicity, SE5, parents' educatigh and «:DioYn5ent status » 
language spoken In the hcacne, and prior preschool experience. 

m Teacher background characteristics . The gaidelines say pttle 
about partlcuiar effects of specific bacKground characteristics, 
but they and_the literature do sUgcest that such factors are 
important influences oh the teacners * behavior and ultimately 
on child development. The guidelines refer specif Icaiiy to certain 
experiences that at least some program teacHers should have had, 

such as training in bilingual education^ or traimng in child 

developtnent ; the literature also suggests tnat ethnicity, number 

of years of teaching ejcperience, and experience in special projects' 
also Influence teachers* professibhai behavior. 



the PDE guidelines do not discuss the precise interactions that are 
assumed to exist c-nong these various factors. Consequent [y. Figure 1 

portrays only a cycle of cohtjhuous interactions that is driven by 

incrroental changes acting on each other in a positive way. One objective 
of tfiis evaluation will be to explore and describe the strength and dlrectic 
of relationships between variables within each dorna-ih. 

However, the guidelines are quite clear in specifying ah order In ^ 
which changes occur to produce impacts cn elements of the interactive cvcle 
represented iri FLgure i. Ariy program that seeks to create cevelopmental 
contihuj ty must first impact bn institutlbhs^ and through them dh parents 
and teachers, before it impacts on chil^dren. Figure 2 presents ah analytic 
fflodfej- that describes the direction of this change flow. 

As shown, PDC is expected to produce fl-'st certain interact ive 

y conditions favorable to the ihsti tutional izatioh or developmentai continuity 
which are then expected to lead tb changes in chi Id development dutcones. 
The operational strategy for producing these favorable cdhditidns Is to 
bring about tne Institutional or structura" changes that then make it 
possible for institutional actors (adSlnis-trators, teachers and parents) 
to engage in educc ' -snal practices that are mutually reinforcing and 
deyelppmehtal ly continuous. At first, it Is expected that tne change flow 
will be mbderated by the cornn:uhitY and educatidnai context as well ^s 
teacher, child and family background characteristics. But Ideally, of 
CTurse, the expectation is to create a chain of interactive changes that 
spread over time to eventually produce the kind of developmental cycle 
Illustrated in Figure 1. In a sense, then, the analytic tSbael of Figure 2 
represents an early stage in the PDC implementation process, and the 
ultimate steady state is represented by Figure 1. 
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Figure 2 
The Change Flow Assumed in PDC 




\ bistioitionaiization of 

ERIC. 



I?e Havie rtcted that the Ult Irate §bal for the ?DC procrair Is tb 
enhance tne social cometer.ce cf the chllcren it serves by prdvidlhg 
developnenta 1 cc^tlnuitv. Sbrie of the assarnptlons iTOiicit In the gaide— 
lines about the Interactive factors Involved In this process. have alreacy 
been exomlned. The cuestion we must a5K next Is exacrlv now tne ?bc 
project was intenced to Ir:i>act _ 'joon tne factors that the guidelines 
assume w]]] oe oresenr in aeve lournental continuity. In other words, what 
Is the PDC treatment? 

A§aln, the D-ocran caideHnes offer the best starting point for 
answering this caesticn. in the Introduction to these guldel Ines the 
following statement appears: 

"Project Devei CDnental Continuity Is aimed at promoting 
greater contlni^ity of educatJor. and ccmorenens : ve child 
development serv I ces for cn i 1 dren as tnev rnaKe the tran- 
sitlon from prescnoot ro scnool . . .DeveloDnental Continuity, 
as It is used here, can De defined as Planned crccrar7S, 
structufer, Svste'^s. or procedures irv ■•;nic'^ ac^-rS crbvlde 
children wit""' excellences zraz ^'oster ar,z sur^ort ccnt'nubus 
develboment ." lerT^^nas is aadec; 

Project Bevelppmental Continuity seeks to enhance cht''idren*s social 
competency by creating greater continuity among children's experiences In 
the school and between children's home and schobi exoerlerices . The guide- 
lines do not atteiTtit to specify what cbht inul ty bf experience should Ibbk 
like, but insteac cutilne a set planned arogrars. Sf LJCtures, svsteTis. 
or procedures thsr» if imp i emented , will result in tne aeslred continuity, 
■these structures, then, are the basic PDC treatment that should be present 
at all sites;, within t^is general framework each site Is free to develop 
its own prograrn. ; 

Table 1 contains brief descriptions bf the str'jctures or brograns 
prescrib^w in T'^e cutcel'^es fcr prcject sites. These crescr i pt Ions out- 
line a set of activities 'or all ?jC programs tb i rr:p 1 erren t . Following 
the earlier modsi , these guldel Ines are aimed at the classroom, at parents, 
and at the school or ce'iter as an institution. 



Identifvlna an Evaluation Methbdolbdy 



Having specified the PDC treatment as described In the guidelines, 
the next step was to ceveicp an evaiuatibn design that .-.as abprbpriate 
tb the goals of tne PDC program. Although this process also began witn 
the program guidelines It was necessarily shaoed by other considerations 
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Table 1 



The FDC Treatment as DescriBed in the Saidelines 
thzt Foster crd Sjrparz CsKtZTiuaus Deis^tcptrssKt 



At the tnstl tntlon al lrg»\/f»l 



I. Fbrrnallzed broad representation In deci siorr-maksng groups Includrng 
parents, staff (Head Start and elementary), conmanity representatives 
involved in edacatfon, health, nutrition, and social services. 

2- . Procedures for oncofng discussion and reflneinent of the carrlculum 

that Include narencs, teachers, aides, etc. 

3- Establishment of a fbnnal or informal Internal assessment system for 
monitoring the school 's progress toward meeting Its goals and objectives 

1. Assign respbns I bill ty for education, handicapped, bilingual^ etc. to 
spec! lie individuals at Head Start and elementary levels. 

2* Prdvisidhs for cbbrdiriation from Head Start through grade 3 pfservices 
to meet the educatlohal and social heeds of handicapped and bilingual 
cfilldreh. 

3. A coordinated parent irivolverneht program from Head Start through grade 3 

1. Provide training on decision making and policy traking for members of 
decIsion-rTiaklnc grouos. ' 

Provide training on the goals and objectives of Both the Head Start 
and elementary programs. 

. 3- Provide training to nake staff and volunteers sensitive to special 
needs of handicapped children. 

hi. Provide training for parents in how to work witfi teaching and adminis- 
trative staff. 

5. Provide training for classroom volunteers. 

6* Provide training for parents in how to work with their own children. 
/• Provide training for parents in child growth and development. 
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Table 1 
(cOTtincad) 

8. Provide training for parents In available cbanunity resources. 

g. Provide training fcr teaching staff :ri ni^tihg the needs of bHingual 
i children. 

to. Provide training fcr teaching staff in the principles of first aid, 
health, and safety practices, 

l. EOTnunication between decislon-naklng bodies and Head Start and 

elenientary school parents. 
2i Regularly scheduled cdrrmurilcat Ion arid coordination between Head Start 

and elementary teaching staff. 
3i EOTtlnuity of record-keep I rig ^ Head Start through grade 3- 

1. Prbvisibri of a broad range of medical , Cental ^ rental healthy and 
nutrition services. 

2. Comprehensive screening and diagnostic assessinent of every child 
upon enrol Irrierit. 

3. Ari aririual survey to Identify handicapped childreri. 

4. Provision of an Interpreter when heeded. 

At the Level of -C lassroom ActivItle S- 
g ContirTyjcziS Cocrdin:zted CicrriduZur: 

1. Develop or adodt a compatible, coordinated curriculum from Head Stlrt 
through third grade. 

2. Have a curriculum that facilitates Che learning of basic educatidnal 
skills for reading, writing, and computation. 

3. Have a curriculum that provides continul ty of educationar and develop- 
mental experiences. Head Start through grade 3. 

Develop a curriculum plan that includes goals and objectives statements 
in each subject or developmental area. 
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Talsle T 
(cbrttinuec'j 

1. : Curriculum must be develcptaental ly appropriate. 

2. instruction must be Indi yidoaUad. 

3* Develop a diagnostic and evaiaatlve system that enables teacher. 

to pinpoint developmental levels of each child based on the child's 
diagnosed strengths and weaknesses* 

Fcnaer teachers consulted when planning edttcational bnjectlves* 

Provide BiTingual/rnulticultural classroom activities^ materials and 
resource persons for all children. 

Develop a comDatlble Head Start-el eihent a ry school approach regarding 
bilingual education. 

Ct assro ar: Services foT S^^i c^rrped Ckitdren ^ 

1. Handicapped children rainstfeaned to the rraximuni extent passible. 

2* Early diagnosis and evaluation of children with learning disabilities. 

3. Special materials, structural changes, or classroom reorgani^zat ion 
jpifdvided as appropriate for acconriodati ng handicapped children. 

^B^te-'Child Persvective 

Have a currjcalum that encourages the physical and sbcial-errot ibnal 
growth of children. 

2-. Health education and nutrition integrated with other educational 
objectives and activities. 

3. Meals and snacks used as an bppiortunity for learning. 

4. Provide nutritional services that reinforce good aspects of foods 
served at home. 

5. .Familiarize children with health services they will receive prior to 

delivery. 

Use vf Cvimurv itif BesoT^es 

I. Bi I ifigual/mul ticuTturat resource persons used in the classroom. 
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Table 1 
(continued) 



jj tthe Levet of rN? Honig_and Hone-SdnooT ActTvItres 

1. Parents Involved trr planning educational objectives for their 
children, 

2. Parents given stsnrary of records on health, nodical services and 
i iffnun i za t i on . 

3. Parents familiarized with available health services. 

1- Parents involved in all decisionmaking bodies. 
7. Parents involved in a"! school decisions, 

3. Activities provided for parents that relate to cultural dynamics. 

Parents used as resburce persons in the classrodn:, 

5i Parents involved in classroom activities, soecial parent eventSr 
activities that stress honie-schbbl ccntinui ty. 

6, Parents involved as observers, aFdes or volunteers in the classroom- 
U Parents encouraged to become involved in health care process, , 
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as well. First, PDC ts not a static prograrn, tacnched and maintained by 

iiTiTiotable_set cf gulcfeiines. Local orograrns through tnei r experiences 
and Iriteracticins with natlchal ACYF staff have crested altered oerceDtions 
of what PDE Is and snould be. These altered percebtidns had to be accortr- 
■odated in the evaluation aesion. Second, the PDC evaluation Itself exists 
within a broader researcn and policy envi ronmen C. ^^*'_l?5ues arid questions 
are.ernergihg regularly that could appropriately be acdressed in the PDE 
evaluation without cdrrordfnis ihg the basic evaluation objectives. ^O"?^"" 
quently, certain researcn questions arid variables have deen added ro the 
study in response to ACYF information needs that.are not necessarily unique 
or even directly tied to the PDC treatment as defined in the guidelines. 
Finally, there are many audiences for the PDE evaluation, each with \_t^ 
own information needs. These audiences Include policy makers in Wash i ngtori, 
the_ research and evaluation cdmrriuniLy, arid of course practitioners in the 
field. Insofar as possible, the rieeds of these audierices have been accom- 
iodated within the evaluation design. 

V . Befare outlining the research questions and associated variables 
for the evaluation, a few words are Ir, order about the process that was 
used to develop the study. The RFP for the second phase of the evaluation 
specified that rhe contractor was to examine the Impacts of the PDE 
program on children, on parents, on teachers, and on the schools and 
centers as institutions. The RFP al^sb spec[f?ed that these impacts were ^ 
to be assessed using a variety of structured and unstructured methodologies, 
from classroom observatidris to interviews and document analysis. 

Early in the contract, several represeritat ives f rom the various 
ttnst I tuencies of the PDC program were invited tp_High/Scope* s YpsFlanti, 
Michigan headquarters to ''bra f hstbrm** about the PDC treatments and the 
Impacts that could plausiblv be expected In each Impact dbmai^n. This 

panel _ iricluded a cddrdlriator from the PDC project In West Virginia, a 

-technical assistance consul tahtfami liar with several sites, and a former 
ACYF project officer fcimlliar with ACYF*s policies^ The panel met w:th 
High/Scope staff for three days and produced a long list of (a) plausible 
impacts and (b) variables tnat might be measured to assess these impacts. 

this irirtial and admi ttedly mass i ve list of Impacts war- next sorted, 

pruned, refined, arid revised by project staff and presented to the PDC 

ASvisory Panel In October 1978. Break:rig irito work groups that concentrated 
on each impact domain, panel members worked with project staff to -further 
prune the list and to establl:>h priorities among the many variables that 
rafght be assessed in each area. This refined list became the basis for 
all instrument development. Further modificatjons and refinements have 
been made td this basic list as new information needs have been Identified 
through ongoing interactions with PDC program staff at ACYF. 
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this phase of the ?5t evaluation Is designed to address three basic 
questions: 

9nct_zrpc:rt vTze rDC y ro^Ttsn rjzd an (a) ^rfcit^^en's 

(b) t^^r^s^ ber^TZV^ ^zc 3tc3STd~orr: cc^vi'iries, did if) 
vzB t t^ tutzoTvzt policies cond lOTCce^are^? 

5L ^resvec^ve of i^eartr^rrt-y wncr:^ fczcwi's cr v<ztzeT7i$ of 
fcartatz heVp a^oian::: far rriedTzingful ctctcarrme in each, 

(JcjJXlL'K? 

To what exterzi 2o these factors ^fe^^tfte TeZationship 
hsrtsjeen the PDC vz^grar: and its in^acrvs? 

Stated differently, the first task of the_PpC_eval uat fon Is to deter- 
mine POe program effecrs rhrbugn comparisons of ?0C arid compari son teachers, 
parents, and children on selected variables. For example, the fredu^ricy 
of parent y: sits to PDC and corrparison schools is conpa red to derermlrie 
%jfether PDC has had ariy impact qn that aspect of parent I-nvolvement in 
schcwDls. The next. task Is to explain the results of these cpmparisons 
using whatever qualitative and quant I tat 1 ve _ Irfonnat ion is available- 
Fbr example, at sites where there are relatively few or rip differences^ 
between PDC and comoa ri son parents' invo^yenierit^ I ^ we may find 

that the ccsnparlson schools have instituted a parent involvanent program 
patterned after PDC's. It might be reasonable to conclude from this that, 
.contrary to appearances, PDC has indeed had an impact upon parent |rvo I vement 
•in the schools in question, and that impact has diffused to the comparison 
institutions. 

Having examined the s imi lari ties and differences between PDC and _ 
— cbinparisdn groups along various dimensrons, the Final task for the evaluation 
is to examine the _ relatibriships among child, parent ,. teacher , insti tat|ona 5 ^ 
and dbcwnun I ty variables, disregarding the PDC/cbmpari sen grouping. Extending 
Se preceding examble, w^ might discover that schools with active and 
successful parent involvement programs, be they PDC or comparjsdri^ tend 
to- have similar institutional pot icies or procedures (such as'' regular 
newsletters, parent training programs, and designated parent mvolvement^ ^ 
cbordiriators) that foster greater Involvement by parents [n school^ activities. 
Uhile.f indings such as these may not reflect directly on the effectiveness 
of the PDC treatment, they would be of bbvLous interest to educators ana 
'^licy makers wishing to expand the role of parents in school programs- 
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£qas-tructs Addressed bv the Evaluatiori 

As we hSve said, a pervading cz5nceni in the design of this evaluation 
tas been ensuring that the doroains and variably iKasured are ind^d 

relevant and approDrfate to the objectives of ^he PDC prxjg ram, Th^ 

fevelbprnent process ^triat was followed to accomplish th Is ^nd has already 
besi described. Fcflowing this process a set of instructs was [dent i^F led 
in eaS impact dona In for attention by the evaliatidn. These constructs 
are listed in tabVe 2. 

_ For the most part, these constructs follow the conceptual I zatipn of 
tfie PDC' treatment that was irapped In the- program guidelines and refined ^ 
by AGYF and project staffs (see Table 2). Thus, the constructs described 

in the cable generally represent the areas In which PDC was supposed ■_ 

to >^ve impacts, and areas In which the nature arid direction of PDC/compariscn 
differences could be predicted. There are some exceptions to th^s general 
rule, however. Most exceptions are found in rte domain of Teacher Behaviors 
and eiassroonr Activities, where several constructs— Structure and Content 
of eiassroom Environment, Classroom Climate, I ntel lectual St rmulat[on , 
Classroom Management , ^and Instructional Approach— were added despite the 
fact that the guidelines are virtual ly silent about. the specific impacts^ 
that FDC should have in these areas'. They were included In the evaluation- 
because other research has indicated that behaviors in each may cbritrlbute 
significantly to child development outcomes. Although few hypotheses 
awild be forSialated about. PDC/cc»npari son differences In these areas, 
Biey were nonetheless included because of their potential utility in 
answering Research Questions 2 and 3» , 



Variables and Data Sou^xes^ 

For- each construct in every domain an array of variables was identified 
through consultation with ACYF, local project staff, ^"^.^[^^^^^^^^P!";'* 
following the -procedures outlined earlier. __For ^^^^''^^^^L^ll^"^ 
were made about the Best sources of Information and data col eqt. on ^m^ 
dolbgy. Wherever possible an attempt was made to "triangulate^ on the _ 
desired information by collecting data;bn the same phenomenon in ^muti^^^ 
ways from different sources. Table 3 lists the data col lection instruments 
and methods developed for the evaluation; more ^extensive Rescript ions of 
the instruments can be found in Volumes I I I I I , IV, and V of ^ 
The appendix to Volume I contains a list of the variabl^s^addTessed_by 
the valuation, the :source_s for information on each variable, and the 
itKesized directions of treatment effects. 
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Table 2 

Dcamains and Constructs Addressed by the PSE Evaluatitw 



0 Acadeinic skills and abilities 

• Health and nutrition status 

• Sdcial-«Tibt ional aevelopinent 



• team I rig attitudes 
9 Elassrocn; behavior 



Role of parents in school 
life 



• Parent-child activities 
in the home 



I 'Parents ^ IncrSjecjje -(md^^ 



Parents' attitudes toward 
tttt school as ah Ihsti- 
tiKtioh 



• Parents' perceptions of the 
schools' help In roeeti^ng 
the needs of their families 



[ 



m Structure and content of 
classroom environment 

• Delivery of special services 
to chl ldreh_ _ 

• Classroom climate 

• Meeting needs of handi- 
capped children 

• Intellectual stimulation 

• Home-schddl continuity 

• Contacts with other teachers 



• Instrtictidhal approach 

• El ass room management 

• Individualization of 
instruction 

• Use of community resources 

• Meeting affective/emotional 
heeds 

• Multicultural perspective 



Teachers ' Atti^.id^s-\ 

• Attitudes toward parental • Attitudes toward the 
i nvo 1 vemen t schiabl /center 

• Perceptions of change 



m Planning and decision making • Commuh ideation and cbbr- 

• Prdvisibh of services ^'_"^^*9'' 

• Use of cornnunity resources • Training 
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Table 3 

Qata CbTl«rtIdh Ffethbdbl ogles* 



\^ Child Deve U 



Instngnent 

Peafibdy Individual Achieve^ 
Test 



McCarthy Scales of Children's 
Abilities 

BtTin^al Syntax Measure 



Preschcxi] _ I nterpersona 1 
Problem Solving Test ^ 

Child Interview 



Child Rating Scale 



Individually administered 
published test 

individually administered 
published test 

Individually administered 
published test 

Individually administered 
publ ished test 

Seni structured Interview 
followed by Interviewer 
ratings 

Teacher ratings of individual 
children 



Pupil Observation Checklist 



Tester ratings of child's 
behavior during test 
administration 



\ Parents^ Attitudes, ?y'jo:Jledae ^ end 3ekaviors \ 

Parent Interview Structured _ interview with 

parents of children in test 
cohort 



*S« Appendix A for complete descriptions of instruments- 

(continued) 



Table 3 
(mntiflued) 



_l n st r us)ent 

Teacter Interview 

C 1 ass iTidni En V i ronron t 
Observation 

Classroan Activities Record 



Fccxised Observations 



Structured interview 
C&eciclist and rating fdnn 

Tiine-s^npl ing observation and 
rating form 

SCTtstructured observations 
rating fonn 



Afeinlstratbr Interview 
Case Studies 

Si^e Visits 
Site Records 



Structured interview 

Documeftts^preDared by"^ Pacific 
CoSiiJitants for ACYF in 
1578^79 

One-week visits by High/Scope 
staff 

Rihutes^ training records, etc 
kept by local project staff 




So 
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How CtvlL d Development Oatcomes Fit 

into the Cohceptual an d Analytical M odels. 

This section describes how assessments of child dUtcdmeS are tied 
into the conceptual and analytic models presented earlier. Webegiri by 
reviewing the specific child development outcomes of interest in the PDC 
evaluation, and then discuss the relationship between these outcomes and 

other variable ddmains (such as parent and fami ly background, teacher 

background and teacher and parent outcomes) within the analytic and con- 
ceptual models of the PDC process. 

efiild development butcomes are grouped into five constructs: academic 
skills and abilities, health and nutri tibn status , social -emdtidnal develop- 
ment, learning attitudes^ and classroom behavior.. In the grade^drie assessment 
twd cdhstructs (health and nutrition status and classroom behavidr) did 
not receive major attention; this situation wiH change in succeeding^ _ 
evaluation years, as technical issues related to consj^deration of variables 
in these constructs are resdlved. Consequently , the measures of chi Id 

development butcomes updh which analytical emphasis has been placed are 

those in the remaining three constructs. Table 3 lists the chi Id development 
measures used in the PDC evaluation; these can be grouped into the three_____ 
constructs in the following way: 

- m-^ ^a&emfc^U^s and abilities.: PIAT-Reading and PIAT-Math; 

Bilingual Syntax Measure; McCarthy Scales; and Verbal Fluency 
subscale. 



0 Soc i a 1 -emo t i ona 1 deve j bpmen t : . Preschddl I nterpersonal Problem- 
Solving Test; Pi3CL-2 '*Task Orientation" subscale; CRS-1 ^'Self- 
Assurance'' subscale; CRS-2 "Aggressiveness" subscale; CRS-3 
"Dependence" subscale; and Cl-l "Attitude Tbward the Teacher" 

- subscale. 

1 . Learning attitudes : POCL-1 "Task Orientation" subscale; CRS-^ 

"Academic Motivatidh" subscale; and CI-2 "Interest in Reading" 
subscale. 

The measures, including their admihistratidn arid scoring procedures, 
are described in Appendix A of this volume, Fbr analytic purposes in the 
present report they have been treated singly or taken together as a whole. 
Future interim reports will deal with the integration bf child dutcdme . 
measures intd majdr research constructs. 

Child develbpmeht dUtcdmes, in the context.o.f the model described 
■ earlier, are seen as dependent dh a complex of constructs from several 
domains. Constructs in the teacher arid parerit domains are seen as those 
nost closely linked to child-level coriStructs.. Specif leal ly, certa[n^ 
teacher behaviors and classroom practices, dri the drie hand, and certain 
parent behaviors toward the child and parental relatldriships with the 
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schools, on the other, are viewed as associated most directly with changes 
in child dutcomes; In turn , .these teacher constructs are deemed In the . 
model to be associated with teacher att i tudes and knowledge, arid ultimately . 
with teacher backgrdurid characteristics; The parent behavibrs are associated^ 
for their part, with. parent attitudes and ultimately with parent and family 
backgroDrid characteristics. The model depicted in Figure 2 can be extended 
even further back toward inst i tut idnal features; but such linkages are not 
iBxplored here. 

The spring 1979 data collection (grade one for the study cohort) Is 
the first occasidri on which data were col lectedslmul taneously Irithe 
parent, teacher^ classrdom and institutional domains. In this volume, 
we have summarized the results of the first limited explorations of associ- 
ation be.*:ween outcomes for chi Idren and variables In teacher and parent 

domains. The results of the study fdr child outcomes are explored through 
three major questions: 

1. What is the impact of PDC on child outcomes at the end of 
grade one? 

2^ Khat-other variables (rn doinalns specified by the model pf 

Figure 2 as most closely linked to child outcomes) contribute 
to explaining grade dne child outcome findings? 

3. To what extent do these other variables alter the nature of 
the educational treatment's impact? 

In respdnding to the second and thi^rd research qaestidns, the variables 
selected for cdris I dera t ion come from three construct areas: 

•teacher background characteristics 

# teacher ^'outcomes": teacher behaviors and att i tudes that might 
legitimately be considered as resulting from processed in the 
^ PDC program 

i family background characteristics. 

In Chapter V, We present analyses of the association between these_ 
variables and child outcome measures. We also discuss i n greater detail, 
some of the issues raised in these analyses and in the interpretation of 
their results. 
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METHODS 



£ata Eol lection Procedures 



To establish a data collection routine that would result in data of 
the highest possible quality, the_ prociedures followed in the preceding 
data collection periods were cbritinued, with minor mod i f icat idns : 

• An organizational structure for individuals, involved _in_ __ 

tne data collection effort was outlined, role responsibilities 
were defined, and detailed training manuals were produced. 

• Training models were designed that specified tester performance 
standards and_provided for sessions with large-group, small- 
group and individual ized instruction, daily reviews of each 
field staff's performance, and discussion of potential problems. 

• bnsite monitoring of field staff by trainers vyas conducted 
prior to the start of the actual data collesction. 

i During the data collection period, testers were responsible 
for mohitbring each other's performance on a weekly basis, 

m Site coordinators collected completed data each week and 
checked it for obvious errors or bmissibns before sending 
it to the High/Scope Foundation. 



Each bf these procedures is discussed below. 



Field Organization 

dob announcements for tester pbsitibns were posted in all sites by the 

local PDC staff. Applicancs were then interviewed by High/Scope staff and 

final hiring decisions were based on their experience. Tn working with children 
as well as the! r performance on a mock test or Interview and their perceived 
ability tb interact ef f ect i vely wi th school staff. The roles of the persbririel 
who conducted field data collection were explicitly defined in the Righ/Scppe^ 
PDC Field Procedures Manual in order to clarify and systematize responsibilities 
In addition to actual testing, interviewing and observing by field staff, one 
tester and bbserver frbcri each site was designated site coordinator. Site 
coordinators* responsibilities, in part, included informing the site'^s POe 
coordinator about the start bf the data collection; setting up and chairing 
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a meeting with the first grade teachers involved in the evaluation, or 
contacting them individual ly; .maintairiirig regular contact with High/ 
Scope*s liaison person to monitor the site's data cdl lection effort and 
to discuss any problems the site was experiencing;, and checking the cdm- 
pleted data each week before mailing the forms .to High/Scope fbr processirig 
From start to finish the data collection effort took approximately nine 
weeks at each site. 



Training Procedures 

Training sessions for both High/Scope trainers and PpC data cbl lection 
field staff were held In March 1979 at the High/Scope Conference Center iri 
Clinton, Michigan. Since all five fligh/Scope tester-trainers had been 
involved in previous PDC training sessions, a brief, one-day session was 
scheduled for them during which they reviewed and practiced the child 

measures and discussed the tester-training agenda and training methods. 

PDC testers attended a four-day trairiirig session Other training sessions 
attended by all field staff included those oh interviewing techniques and 
field logistics. 

Tester trawJ-ag- . During the tester training session^ each test was 
presented and practiced in small groups. Practice sessions involved the 
use of test "scripts" which consisted of test instruct ions^chi Id responses 
and rationales for scoring. In using the scripts, two testers would pai r 
up and one (the "chijd") would perform as indicated on the script while 
the other tester administered the test without the script. This provided 
an excellent learning situation because the child responses included on 
the script covered all the admi n I st rat ion rules and gave the testers a 
chance to work with and correct each other. Also, since the majority of 
testers were experienced PDC testers they were able to help the new testers 
with test administration procedures and ?[ve advice on their "tried and 
proven" techniques for establishing rapport and interacting with children 
and teachers. 

In order to insure that testers admi n is tered the tests in a standard 
manner, each tester was systematically "checked-out" on al 1 of the child 
measures before the end of the training sessibn, During this procedure, 
a High/Scope trainer played the role of the child (also recording the 
"child's" responses) while a tester administered one or more of the child 
measures to her. The High/Scope trainer (acting as the child) responded 
in standard ways to each item on each test in order to insure thatr (1) 
each tester was exposed to the same s i tuat ions , and (2) the trainer could 
assess the tester's handling of critical child responses. For example, 
on the PIPS interview, there are specific things for a tester to say if 
a child gives ah unrelated answer^ a repeated answer, refuses to answer, 
and so on. By exhibiting all these behaviors in thecheck-but situation, 
tra-iners were able to assess the tester's understanding and expertise in 
administering each of the child mea'sares. 
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Standards were set for acceptable performance duri^ the tester 
check-butSi and if these standards were not met; additional train 
practice, was prescribed. Chieck-outs were then repeated at a later time 
during the training session to insure correct test administration. 



Moni toring 

Onsite tester monitoring- . Ons i te monitoring occurred the week 
follbwihg the training session fn all sites where new testers had been 
hired. During the. mdnitdririg session each of the testers administered 

the PDC measures to a child while a High/Scope trainer observed the 

interaction. After the session^ the High/Scdpe trainer provided feedback 
(if necessary) to the tester on ways to improve her iriteractidns with 
children. This monitoring procedure served two purposes: Jl) it gave 
the trainer an indication of how well the new tester was able to establish 
rapport and interact with children; and (2) i t helped al leviate some of 
the anxieties the inexperienced testers felt about administering the 
measures to children. 

V/eekly tester mbni tbrlng . _ During the course of each testing week, 

testers at each site alternately monitbred each other. One tester acted 

as monitor and simultaneously completed the test bddk'.ets arid the individual 
monitoring for;:-s for each test. 'After the session^ the **mbnitdr" and 
tester discussed any errors and the monitoring bbbkletsand forms were 
sent td the supervisor of field operations at the High/Scope Fbundatibri 
tb be reviewed. 

Weekly Pre-Transmi ttal Data Checks 

Testers were required to give or send their cdrhpleted data to their 
respective site coordinators at the end of each week. These staff then 
checked the tests for recording/scoring errors. (Site cbbrdiriatdrs arid 
testers reviewed a checklist specifying what to look for when, rev iewi rig 
each completed booklet, e .g . , I s the ident I f i cat ion compl^ete?' V '*Did the 

interviewer skip ari item?'*) Errors were pointed oat to the particular 

tester and, if necessary^ further training was provided by the site coor- 
dinator. The site cbbrdinatbrs alsb kept track of all completed data 
(in addition to the individual recbrds each tester arid observer kept) and ^ 
were responsible for mailing the completed data to the High/Scope Foundation 
Ori a weekly basis. 

Recbrdirig arid Scdririg <3 f Data 

In addition tb the site coordinators' Pre-sabmittal check, data ^ 
collected by the testers ahddbservers were also checked by the supervisor 
of field operations at the High/Scdpe FdUndation. The supervisor of field 
operations identified any errors iri recbrdrrig or coding and notified the 
site coordinators, who then discussed the errbrs with the testers and 
observers at the site. 
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6n6e the raw data were. screened for accuracy at High/Scope, they 
were sent to the F5uhdat|bn*s dataprdcessihg section to be tagged with 
unique identification numbers for each student^ scored and verified, and 
then keypunched and verified- 

Daia Collection Sequence 

Once the sample children for the evaluation were located in the 
district schools, the field staff divided the classes among themselves. 
In making these divisions two factors were. taken into account: (1) the 
order in which the classes were to be completed was such that testers 
would becbllecting data simultaneously in the PDH and comparisdn school S, 
and (2) each field staff member would be testing or observing in both PDC 
and comparison observer bias for either group. 



Data Analysis Procedures 

Chapters. IVand V of this report present the results of five sequentia 
-stages of analysis of PDC data, focusing. on: 

• descriptive characteristics of PDC and comparison group samples 
for which data were collected in spring 1979; 

• attrition patterns in the spring 1979 samples, and their 
consequences ; 

m characteristics of the instruments in the spring 1979 PDC 
battery; 

• impacts of the PDC program on participating children^ both over 
time and as of spring 1979^ when almost allof the children in 
the study cohort were In grade 1; 

• prelimihary analyses of factors other than treatment that might 
help to account for the identified impacts on child outcomes; and 

• preliminary analyses of the relation between teacher characteristic 
and child butcbrries independent of treatment- 



Descrip tive Characteristics of the Samples 

In order to understand the composition bf the PDC and compan son child 
samples for which data were coUected In spring 1979, descriptive stat istic< 
were computed and tabulated for these samples at each site and for all site! 
comb i ned . 
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Previous reports have defined an analytic sabsample for chil^d- level 
analyses, a subsample which excluded chi Idren with defined handicaps or 
with a dominant language other than English. The analytic sabsamplej in 
other words, has In the past. been smaller than the ful 1 sample for whom 
data were collected. \n analyses. of spring 1975 data, the full sample 
was employed except for those analyses that include pre-197S data for 
which children tested in-^a.n-ish- at some time points had to be excluded, 
the rationale '^or Inclusion of handicapped and Spanish-speaking children 
in the analytic sample for this report Is discussed In Ehapter IV. 



Attrition Patterns 

Representativeness of remaining sample children . Chi Idren who 
departed the PDC and compar[son group samples through spring ^979 were 
compared with the children remaining In the study samples on a number of 
background variables and on fall 1976 test scores. The purpose of these 
analyses was to determine whether any differences bec^/een these two groups 
of children .could be identified; sUch differences wotila indica'.e that 
selection effects had operated to dimihishthe representativeness of the 
samples remaining. The hypothesis of attrl tioh- induced changes In the 
samples was evaluated by means of univariate and mwl t i var iate one-way 
analyses of variance, and for honlnal data by chi-square analyses. 

Cbmparabl 1 i ty^ of remaining samples. The samples of PDC arid cbmparisori 
group Chi ldren_ tested in spring 1979 were compared on background variables 
and entry-level test_ scores to determine whether these groups might still 
be considered equivalent In their characteristics at the time of program^ 
entry (fall 1976). Again, univariate arid multivariate one-way analyses of 
variance and chi-square tests were employed. 

Characteristlcs^ of the In s trumen ts. 

Because the priricipal instruments assessing child-level outcomes Iri the 
spring 1979 test I ng battery have, in earlier PDC analyses, passed through^ 
at least two screenings based bri psychometric cri teria, no further screening 
was considered necessary _ before dati cbl lected with these Instruments were 
entered into outcome analyses. Psychbrnetric analyses are presented in this 
report principally for purposes of further Iristrumerit definition and^doca- 
meritation. Psychometric properties reported In Chapter IV for the B3M- 
Engl Ish/BSH-Spanish, PIAT-Math, PI AT-ReadI ng, Chi Id _ I ntervi ew Scales, 
Child Rating Scales, POCt 1 and 2, and the PIPS include: 

0 overall ceritral tendency, dispersion and distributional _ 
characteristics bf summary scores or sca[e scores (usually 
as means, standard deviatibris and histograms) 
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• assessments of reiiabllity (as internal consistency estimates) 

• assessments of validity 
n assessments of stability 



• assessments of sensitivity to change 
i variable i htercdrrelat ions 

• factor structures 

• relation to an assessment of "social competence" 
9 item analyses 

Analytic Strategies for Examiriihg the Impact i^f- P-QC 

Evidence of PDC's influence on children is examined in the first part 
of Chapter V. The analytic strategic:, used there to measure PDC's effect 
are described briefly below. A number of analytic questions are posed: 

1. Is there a difference between the PdZ and comparisjn groups 
for each of the child outcome measures on which data were 
collected in spring 1979? 

2. Is there a difference between the PDC and cbmpari son groups 
in outcome measure profiles, when al] child impact measures 
obtained in spring 1979 are combined? - 

3. Is there a difference in the growth curves of the PDC and 
cbmparisoh groups over time, considering each oatcorne 
measure separately? 

k. Has a difference between the PDC arid cOfUparison group children 
emerged between assessments in the spring of their kindergarten 
year and spring of their grade 1 year, cbrisidering each outcoftie 
measure separately? 

these questions are addressed through uhivariate and multivariate analyses 
of cbyariahce. The first analytic question is addressed through a series 
bf univariate analyses of covarlance; the second, through a single cross^ 
Sectional multivariate analysis bf covariance incorporating all child- 
outcome measures obtained in spring 1979 as dependent variables. The 

third and fourth questions are addressed together thrbugh the use of 

multivariate repeated measures analyses examiriihg _bhe butcbme instrument 
at a time, including tests for growth trends and fbr change patterns over 
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theperldd subsequent to .earlier measurements: eovariance adjastments ^X:. 
of the data are performed: iri order to. cbmpehsate for differences between 
groups at entry, and to adjust for differences, between treatment groups 
associated with sex, ethnicity and prior preschool experience. 



Analytic Strategies for AssessOxtg ^actor^ A ffecting PDC Impact 

The effects of site and the interactions of s i te wi th treatment In 
relation to child outcomes were analyzed in the course of answering 
questions relating to program impact . The influence of these factors 
on child outcomes is discussed in Chapter V. Also discussed in Chapter V 
are the effects of the covarlates used in the child Impacts analyses: 
sex, prior preschool experience, and ethnicity. 

The effects of language spoksn at time of entry Into the study, age 
at entry, and two family characteristics (mother ' s education and number^ 
of siblings in the family), are also explored In Chapter V. The analytic 

approach used In these preliminary explorations is multiple regression. 

The dependent variables are those child outcome measures that show evidence 
of outcome differences in the assessment of program impact^ In order to 
establ ish. whether the effects of these variables modify statements about 
the impact of the program, regress ions are conducted i n two ways: both 
including and excluding a dummy variable for treatment. 



An^i7X4-C Str^t^gi^^-for Assessing the Relation Between Teache^^-Ch ar a c t er i st ics 
and -Ch-I ^ j-Q utcomes 

^he relation between teacher background characteristics, teacher attitudes 
and behaviors, and child outcomes Is explored in a preliminary fashion in 
Chapter V- Technical problems in the consideration of relationships between 
other variable domains (such as the parent domain) and child outcomes are 
also discussed In that chapter. 

Again, multiple regression is the analytic approach used, with the 
dependent variables being various measures of child outcome. 
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SAMPLE AND Instrument characteristics 



Characteristic:^ o f the S a mple 



Sone ra T Descript Jon 

A total of 551 children were tested at 11 PDC sites in spring -1979- 
Tabled displays the numbers of children in the PDC and comparison groups 
at each site and describes the composition of each group. 

All of the children tested entered into tht analyses presented in 
this report, except where we have noted that some children were excluded 
because of incomplete data for analyses that spanned several timepolnts 
or examined several instruments s ImuUaneous ly^ In part icu Ur > chUdren 
classified by local educational agencies as handicapped are included in_ 
the main analytic sample. Children initially tested in Spanish are included 
with children initially tested in English for- some anal yses. This practicer, 
differs from that of previous analyses and reports; the rationale for both 
decisions Is discussed below. 

The rationale for exclusion of children identified as handicapped 
from the analytic samples in previous reports (cf. for example Granvi 1 le 
et al., 1979, Report IX) was concern that handicaps might unduj^y_ irripa i r 
the children's test performance. For this report analyses: were conducted 
to establish the extent arid importance of differences between handicapped, 
and nonhandicapped children irt the spring 1979 sample; results are summarized 
in Table 5. Means for the handicappedchi Idren are wel 1 w[thin acceptabte 
instrument ranges, and standard deviations are quite comparable for the 
:two groups. Subgroups of handicapped children classified as to type of 
haridicap were also compared, w[th the same results. There appears to be 
nb_reasdri why any of the chi Idren classified as handicapped > iri the spring 
1979 PDC sample should be excluded from analyses on test-perf ormarice grounds. 

Children judged by teachers and observers or examiners to be Spanish- 
dominant had. In years prior tb^]979, been tested in Span ish rather than 
English.. For this reason, in past reports they have been excluded from 
the main analytic sample and cons idered . in separate analyses. In spr[ng 
1979, however, all chMdren were tested in English. Jt became appropriate, 
therefore, to consi der whether these children could be included within the 
analytic sample to the extent possible, or should as in past years be 
treated separately. 
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Table if 



Spring 1979 Sample eompos i tion and Distribation by Site 





Number in 
Ful 1 Sample: 




% Handicapped 


PDC 

CALIFORNIA " 
, Lomp 


21 
25 


29 
16 


COLORADO 11-^ 

comp 


20 
14 


0 
0 


PDC 

CONNECT i CUT ^ 

Comp 1 


35 


12 


PDC 

FLORIDA 

Comp 


31 

26 




7 
9 


GEORGIA PDC 


27 


k 


PbC 

CO.P 


15 

14 


0 


.^^YbAND 


27 
?? 


22 


.PDC 

MICHIGAN . ^ ^ 

Comp 


21 
32 




0 
0 


PDC 

^^^S Comp 


37 

no. 


17 

25 


PDC 

Comp 


23 

3'^ 


26 
18 


WASHINGTON ^1^^^" 


25 
?6 


2h 
0 


PDC 

TOTALS BY SftOUP . 

Comp 


2S2 


. 1^ 


TOTALS, ALL GROUPS COMBINED 


551 




j3 



ETHNICITY 


SEX 


u 

S3 


0 

c 

10 

0. 

M) 
X 


(0 c 

^ (d 

"O ^ 

C (A 

— JD 

c < 
(0 

— > 

0 4-i 

E -fO 

< :3 




0 
y 

<0 I- 

c c 

(A (/) 
< — 


m 
E 
Q) 


3: 
&^ 


5 

H 


95 
32 


g 

0 


0 

Oft 


0 
0 


71 

oO 


29 

fin 


15 

V 


75 
79 


0 
0 


10 

2 1 


0 
0 


35 

30 


65 


51 
06 


29 


3 


17 

*> 


0 
0 


51 
Jt It 


hs 


100 

85 


0 
12 


0 
0 


0 

4 


0 
0 


32 
35 


68 

65 


85 


0 


0 


15 


0 


56 


44 


33 

^1 


7 
0 


0 
7 


60 
72 


0 
0 


47 
50 


53 
50 


44 


•7 


0 


48 
36 


0 
5 


37 
50 


S3 
50 


57 
75 


5 

3^ 


0 

a 


38 
?? 


0 


52 


48 


3 
0 


78 
90 


0 
0 


19 
10 


0 
0 


38 
53 


62 

47 


0 
3 


26 
12 


0 

. 6 


7^ 
79 


0- 
0 


39 
62 


61 
38 


24 
42 


0 
8 


20 
4 


40 
54 


16 

0 


56 
73 


44 
27 


4o 


30 


2 

? 


27 


1 

0 


46 
52 


5i 

48 


39 


30 


2 


29 


1 


49 


51 



LAN- 


GUAGE^ 






CO 


to 


II. 


c 


O) 


fO 


-C 


CL 


UJ 


C/5 






— ?rp 


1 A 


7? 


ofi 


] QO 


A 

0 


100 


A 

0 


77 


23 


1 00 


0 


1 00 


A 

0 


100 


b 


1 00 


U 


100 


0 


IOC 


0 


1 00 


0 


100 


0 


100 


0 


100 


0 


32 


68 


35^ 


^5^ 


100 


0 


i^a 


0^ 


100 


0 


100 


0 


87 




88 


12 


87 


13 







^Language in which child was tested in the study cohort's Head Start year 
(1976-1977). 
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Comparison of Handicapped (n=72) and Non-Handicapped 
(n=if66) Children in PDC Spring 1979 Analytic Sample^ 





Handicapped 


Non-handicapped 


Difference 


1 mal e 


67^ 


49% 


— 


Age at 

orS 1" fv/ 1 rnrt ' 1 
d 1 L 1 y V "■>^ * / 


53 5(4.2) 


S3.8(if.2) 




Mother's 
Educ. (yrs.) 


I0.i»(2.8r 


\ 10. 6(2. if) 




BSM-Engl ish 


12.ij(3.0) 


■ 1-2^3.0) 




Verbal 
Fl uency 


^ 16.1(5.8) 


16.if(^) 


sd) 


POCL-1 


38.0(10.3) 


if2.2(l0.3)\^ 


peeh-2 


li».9(^».7) 


15.0(A.6) 




PIAT-Math 


16.5(5.3) 


19.1 (6.1) 


(-.if sd) 


PI AT- Reading 


20.9(6.5) 


23.1(5.6) 


~^.i» sd) 

\ 



^Information on handicap status is not available for 13 children J^n\^he 
spring 197S analytic sample. Except for sex, table entries are nieartS- 
(standard deviations). Differences are presented as approximate standard 
deviation unit equivalents, where appropriate and greater than .1 standci^rd 
deviation. \ 
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Comparisons of chi I d. outcome scti^res for. chi 1 dreh i n i t ia 1 1y_ tested in 
Spanish and those initially tested ih^E^glish^ using spring 1979 data^. 
were carried out at site and aggregate levels- The comparisons showed 
that there was no reason why, in terms of ma>or test-performance criteria^ 
the two groups could not be analyzed together. NJable 5 presents site-level 
data for chi 1 d ren i n i t i al 1 y tested in Spanish ands£ngjish for selected 
child outcome variables measured at grade 1 (springX979) - 

Although it seems both desirable and justifiable tha>t_ a single analytic 
sample be formed regardless of initial testing language^ cdripern about 
initial comparability in the IbngI ttidinal design of the study^ snakes certain 
compromises in analysis necessary- Measures prior to 1979 diff^ for these 

two groups by language of administration; although the measures are, 

anarogpus, they are not identical and might be tapping somewhat different 
psychological constructs. Consequent ly, repeated measures analys.es infepr- 
porating data from earlier years, as well as analyses of spring 1979 data^, 
using entry-level data as covariates, are .performed separately for subgroups 
initially tested in Spanish or English (cf. Chapter V). However, analyses 
of sample and instrument character istlcs, appearing in this chapter,^ and 
outcome analyses restricted to spring 1979 data In the next, are presented 
for the combined sample of children, including together those initially 
tested in Spanish and thosis initially tested in English. 

Child Sample Attrition Patterns arid Their Effiscts 

Since entry into the Read Start program. In fall 1976, the available 
sample of children for the study has gradua 1 1 y grown smaller. The present 
section examines patterns of attr i^tjon and the! r effects on the represen- 
tativeness of the sample of children rema in jng and on the comparabi 1 i ty of 
PDC arid comparison groups remaining in the study at the end of first grade 
(spring 1979). 

Attrition patterris - _'3ble_7. displays the pattern of att ri t ion by s i te 
and treatment group from fall 197$ through spririg 1979- Overall, the total 
PDC sample has been reduced by 5U, and the total comparison sample by 52% 
In the evaluation's first phase, it had been projected. that attritidri rates 
for this period would be kh% for the PDC sample and 51^ for the comparison 
sample. 

Attrition's effect dri samp 1 e -rep-res en tat i vene ss- : ^^yond [ts effect 
on sample size, attritjdri cari_read to samples that are not representative 
of original program groups. _Fdr example, if families of higher socioeconomic 
status are more mobile than families of lower status, the mean socioeconomic 
status of families remaining in a study suchas the present one will decrease 
over time, perhaps to a point such that the 1 bng i tud Iria 1 sample can no 
longer be considered to represent the original study sample. Therefore, 
arialyses Were conducted to assesschanges in representativeness iri the 
sample available to the study as of grade 1 (spring 1979)- 



Table 

Means arid Staridard_Devlat Ions for Chtv^^dren in! tial ly Tested In 
Spanish and English Overall arid at Three SI tes_dri Six Child 
Sutcome Variables In the Spring 1^79 Arialytic Sample^ 



Outcome 
Variable^ 



N (Tested In Engl I sh/ 
Tested in Spanish) 



Cal i fornia 



35/11 



Eonnect i cut 



\ 



68/8 



Texas 



26/51 



O ve ra IX 



Mh/fQ 



BSM-Engl ish: 

Tested in Engl i sh 
Tested In Spanish 

Verbal Fluency: 

Tested i n Engl ish 
Tested in Spanish 

POCL-1: 

Tested in Engl i sh 
Tested in Spanish 

POCL-2: 

Tested In Engl jsh 
Tested in Spanish 

PIAT-Math: 

Tested in English 
Tested in Spanish 

P>^T-Reading 

?;ested i n En§l I sh 
Tested in Spanish 



13. 7( 2.1) 
13. 2( 2.3) 



l6;d( 5.^) 
lij.8( 6.5) 



36.9( 7.^*) 
i»4.9(10.4) 



13. 6( 3.1) 
15^0( ^.0) 



17. 0( 4.0) 
16. 7( 6.1) 



21 .1(5. 0) 
ig.8{ ij.2) 



12.1 ( 2.4) 
7.9( 3.0) 



20. l( 5.5) 
13. 6( 5.0) 



42.7(11-4) 
37. 8( 7.1) 



14. 3( 5.1) 
13. 7( 5.4) 



17-4( 4.8) 
l4./:.( 3.3) 



22.1 ( 6.4) 
15. 3( 7.0) 



15. 0( 1.4) 
13. 2( 2.1) 



17. 4( 4.9) 
13. 8( 4.3) 



44. 9( 9.5) 
41.3(12.5) 



16. 3( 4.9) 
14. 6( 5.5) 



23. 0( 6.6) 
17.1 ( 3.8) 



26. 2( 5.1) 
22. 8( 4.4) 



13. K 2.4) 
12. 6( 2.8) 



18. 4( 5.6) 
14. 0( 4.7) 



41.6(10.4) 
41.3(11.8) 



14. 5( 4.6) 
14. 5( 5.2) 



18. 4( 5.5) 
16.8 (4.2) 



22. 7( 6.3) 
21. 6( 5.1) 



^ Numb 



„u,„wers\pf cases may vary slightly w . . v 

Table enrt;Jes are presented as: mean (standard deviation). 



thin sites from one measure to another. 
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Table 7 

Suramary of Year-to-Year Attrition 
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Table 8 presents entry-level values on background characteristics 
and test scores for children in the onglnal sample, chi Idreh remaihihg in . 
the_sampre as of spring 1979, and children |ost to the study over the period 
I97S-I979. Test d^ita for children tested at entry in Engl ish and jn Spanish 
are presented separ-^tely, given the difficulty of Interpreting combined raw 
means for these two groups taken together- 
Table 9 summarizes the results of comparisons between remaining _ 
arid departed child sabsamples for the chi 1 dren i ni t ia 1 1 y tested in English, 
for those initially tested in Spanish and for the fuH analytic sample. 
In order tb be able to compare remaining and departed subsamples for the 
full analyt ic_sample, corresponding test scores for each group tested at 
entry in a different language were separately standardized and polled. 

As Tables 8 and 9 show, significant differences between the sample 
remaining and the sample departed over the study^s three years appear 
both for background characteristics and for test scores. The ethnic compo- 
sitich of the study sample has changed significantly from entry to spring 
1979: the proportion of children of black and Hispanic origin has increased^ 
while the_prbpprtion of .children of white origin has decreased.. The pro- 
portion of children withpripr preschool experience has increased. For the 
subsample of children initiany tested in English, changes in entry-level 
test scores appear as significahtdifferehces between the sample remaining 
and the sample departed for the WPPSI, for which_the_samp]e remaining has 
slightly lower mean levels, and for the test of Arm Cobrdi riat ibri, for which 
the sample remaining has slightly higher mean levels. The_subsample bf 
children tested initially in Spanjsh shows significant differences for 
three tests: the BSM-Spanish, Arm eoordination and Draw-A-Chi Id. In all . 
three cases, thesample remaining has higher scores than the sampl e departed . 
For the full analytic sample, significant differences between chj^jdren 
departed and those remaining appear fbr twb measures: Verbal Memory-1 and 
Arm eoordination. In both cases, the sample remaining is higher in mean 
levels than the sample departed. 

Entry-level differences in test scores were also examined in a multi- 
variate analysis of variance considering aH variables simultaneously fbr 
each sample bf children. Separate multivariate analyses were performed 
for children initially tested in English, chi Idren tested in Spanish, and 
the full analytic sample.. All ten entry-level test scores were included^ 
as dependentvariables.. Sample size for these compari sons ranged between 
92^ and 3h%'^f the total available, since bnly children with data on all 

ten variables could be 1 ncbrporated i n _these analyses. Multivariate tests 

revealed statistically significant differences.betweeri remaining and departed 
samples for the subsample initially tested in English (F =2.03, 10 and 966 
degrees bf freedom; p = .028) and for the total analytic sampTe (F = 1.86, 10 
and 1,073 degrees of freedom; p = ,047), but not for the subsample i ni tial 1 y 
tested in Spanish (F = l.U, 10 and 96 degrees of freedom; p = .33). 



3.7 



Table 8 



Representativeness of Remaining Study Sample: 
Comparison of Sample Remaining and Sample Departed as of 
Spring 1979 oh Background Characteristics and Entry bevel Test Scores 





Ful 1 Analytic Sj 


3mpl e 




R^r\dnm\ini^ Pha rpc fe r 1 s t T CS 


Original Sampile^ 


Spring 1979^ 
Sample Remaining 


Spring 1979: 
Sampl e Departed 


N ( maximum) 


1 136 


551 


585 


fctnn 1 c 1 ty x-bj - 
Black 
Hispanic 

American Indian/ 
Native American 
White 

Asian/Pacific Islander 


36% 
27 

2 

33 
2 


39^ 

. 30 

2 
28 
1 


3ft% 
2k 

2 

37 
3 


Sex(*) 
Male 
Fema 1 e 


50% 
50 


5U 
kS 


'»9% 
51 


Prior Preschool 
Yes 
No 


15% 
85 


17% 
83 


13% : 
87 


Age (months, at entry) 
Number of Sibi ings 
Mother's Education (years) 


53-8 
1-91 
10-7 


53-8 

1.97 
10.6 


53.8 

"1:85 
10.8 



^Children fron the_West Virginia site, which dropped oat of the longitudina 
study In summer 1978^ are hot ihcluded. 



:^Difference on this variable between remaining and departed groups sighiflcaht 
with p<. 10. 

Note: Table ehtries are group means, except as indicaied. 
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Table 8 
; (cdritlhUed) 



Sample initially Tested 


in English 




Fal 1 1976 Test Scores 


Original Sample^ 


Spring 1979: 
Sample Remaining 


Spring 1979: 
Sample Departed 


N { approxrmaie) 


1019 




538 


BSH-Eri§lish 
WPPS 1 * 

Verbal Fluency 
Verbal Hembi"y-1 
Verbal Memdry-3 
Arm Coordinatibn " 
Oraw-A-Child 
PIPS 

POet-1: "Task Orientation" 
POeL-2: "Scciabil ity" 


9.11 

H. SM 
5.97 

13. 10 
2.6M 
3.39 
3.85 

I. 99 
32.88 

12.8ft 


9.00 
ft. 72 
b. 1 2 
13.ftO 
2.60 
3.60 

3.73 
1 .92 
33.22 

12.93 


9. 21 
5.13 

12.8ft 

2.67 
3.21 
3.97 

2.06 
32.57 
12.75 



^ehildren from the West Virginia site, which dropped out of the longltud? 



study in summer 1978, are not Included. , ^ 

^'^Difference oh this variable between remaining and departed groups slgni 
with p<JD- 

Note: Table entries are group means. 



Table 8 
(cbnt i nued) 



Sample Initially Tested in Spanish 



Fal 1 1976 Test Scores 



Original Sample-' 



Spring 1979: 
Sample Remaining 



Spring 1979 
Sample 



/7 r approximate) 



BSM- Spanish" 
WPPSI 

Verbal Fluency 
Verbal Memory- 1 
Verbal Reniory-3 
Arm Coord iriat ion- 
Oraw-ft-Chi 1d" 
PiPS 

POCL-1: "Task Orientation' 
POCL-2: "Sociability" 
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70 



10.91 
6.71 
i».D6 

12.07^' 
2.02 
3.90 
4.10 
1 .70 
29.65 
11.16 



11.71 
7.17 

'».39' 
12.89 
2.22 
If. 38 
i»-53 
1.86 
30.10 
11.19 



i»7 



9.73 
6.02 
3.56 
10.85 
1.72 
3.13 

1 .kk 
28.96 
11.13 



IChiidren f rVm fFTOes^- Vi rg in i a s 1 te , whi ch dropped but of the longitadinal 

study in sUrmier 1978, are not included. 
^Difference on this variable between remaining and departed groups significant 
wi th p <. 10. 
Note: 



entries are group means. 
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Table 9 



Representativeness of Remaining St Sample: 
Univariate and Multivariate Test Score ebmparrsoHs of 
Samples Remaining and Departed, by tangaage of 
Initial Test arid Grouped Together (Full Analytic Sample) 



Fall 1976 Test Score 



Uriivariate Cbmparisori 



BSM-Engl ish 
BSM-Spanish 
BSM-both tests 
WPPSI 

Verbal Fluency 
Verbal Memory-1 
Verbal Memory-3 
Arm Coordination 
Draw-A-Chi Id 
PIPS 

Peet-1 : "Task Orientation' 
PDCL-2: ''Sociabil ity'* 



Lariguage of Initial Test: 



Erigl ish 



1019 



n .d < 



.06(D>R) 

ri.d. 

n .d. 

n .d. 
.Oij(R>D) 

n.d. 

n.d. 

ri.d. 

n.d. 



Span I sh 
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Full Arialytic Sample 



.05(R>D) 

n.d. 
n.d. 
n.d. 
ri.d. 

.07(R>D) 
.0i»(R>D) 

ri.d. 

n.d. 

n.d. 



1136 



ri.d. 

n.d. 

n.d. 
.09(R>D) 

n . J. 
.b2(R>D) 

ri.d. 

n.d. 

n .d - 

ri.d. 



Multivariate Comparison 



Al 1 Tests Together: 
Significance 



977 
(95.9%) 



.03 



107_ 
(91.5%) 



n.d. 



1084 
(95.41) 

.05 



^Table entries are: n.d. ?f there [s no significant difference between 
samples remaihing and departed; or significance level of d I f fererice and 
direction as x(R>D) where R: sample remaining, and D: Si 
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In suiTii _attr 1 1 idri of children from the sample between fall 1976 
and spring. 1979 has altered its composition to some degree. This 
finding differs from the results of similar analyses conducted on 
Samples remaining at the end of the Head Star t _ year (spri ng 1977, 
reported in JD_terim Report VII, Volume 3 , PP- 17-22) and c?n samples 
remaining at the end of the chi]dren*5 kindergarten year (spring 1978^ 
reported in I nterim Report I X , pp. lB-21). 

The finding does hot appear to have any major implications^ however. 
While both multivariate and univariate" analyses indicate that the sample 
remaining at the end of grac'e 1 is not quite the same as the original 
Sample for the study, differences areneither cons istent ridr substantial 
and are not expected to alter the validity of study findings. For one 
thing, there is no clearly discernible trend in the direction of sample 
changes. Changes in background character i stjcs cannot be readily inter- 
preted as changes in socioeconomic status; "I'no^' ^^f'" group com- 
position has increased, but mother's education has remained unchanged 
and the proportion of children with preschool experience prior to Head 
Start has increased. Changesjn test score entry levels also fail to 
show any consistent trend: of the ten d i fferences between mean levels 
for each of the subsamples initially tested in Erig I i sh and the full 
analytic sample, half favor the sample rema in ing and half favor the sample 
departed. Further, differences between groups are small (about .| 
standard deviation units or less in magnitude of differences between 
group means) . 

Attrit ion's effects on group comparat>i-l i ty^ . When PDC and comparison 
children entered Head Start, they were found to have very nearly the same 
background characteristics and test scores ( Interim Report VI- , pp. 30-36)- 
This is to say, PDC and comparison samples differed bnly_ in the treatment 
groups to which they were assigned. By the end of the kindergarten year 
(spring 1978), the samples of PDC and comparison chridren remaining in the 
study were still quite similar with respect to background and entry-level 
test scores (Interim Report IX, pp. 16-21). Here we present a series of 
univariate and multivariate analyses of background character ist[cs and entry 
level test scores comparing PDC arid comparison groups at the end of first 
grade (spring 1979). 

Table 10 compares the background characteristics arid entry-level test 
scores of PDC and comparison children remaining in the sample in spring 
lg7g. As in the preceding section, test scores are reported separately 
for children initially tested in Spanish and in English. 

Table 11 summarizes stat i st ical tests on the comparisons presented 
in Tabie 10, together _wi th the results of analyses for the fuM analytic 
sample, combining chi ldren_ initial ly tested in Spanish and Engjish. The 
latter analysis was accomplished by separately standard Iz Ing the test 
scores for children tested in Spanish and English, then pooling the stan- 
dardized scores for analysis. 




Table 10 



Comparability of Remathing PDC and Cbrhparlsdh Children 
on Baseline (Fall 1976) Characteristics 



Fal 1 Analytic Sample 


Ba ckg found Cha racter I s 1 1 cs 


PDC Sample 
Spring 1979 


Cbrhparisbh Sample 
Spring 1979 


i7 (maximum) 


2S0 


271 


Black 
Hispanic 

American Indian/Native American 
White 

Asian/Pacific Islander 


411 
29 

2 
27 

1 


36? 
32 

2 

30 
0 


Sex i%) 
Male 
Fema le 


Sk% 
46 


49? 

52 


Prior Preschool {%) 
Yes 
No 


16% 
84 


13% 
81 


Age (months) 
NamBer of Sibl ings 
rtother's Education 


53.68 
1.97 
10.70 


53.87 
1.95 
10.49 



Note: Table entries are grdufj means, except as indicated. 



Table 10 . 
(cont iriued) 



Comparability of Remaining PDC and Comparison Children 
bri Baseline (Fall 1976) Characteristics: 
Sample Initially Tested in English 



Sample Initially Tested in English • 


Fall 1976 Test 


Scores 


PDC Sample 
Spring 19/9 


Comparison Sample 
spring ly/r 


zV (maxzmm) 


245 




BSM-Engl ish 




8.72 


9.32 


wppsi 






5.10 


Verbal Fluency 




6.16 


• 6.10 


Verbal Memory-1 


\. 


13.11 


13.70 


Verbal Memory-3 


V 
\ 


. 2.56 


2.68 


Arm Cbbrdlhatidri 




3-39 


3.83 


Draw- A- Chi Id 




3.58 ' 


3.9a 


PIPS 




1.90,. 


1.9/ 


POCL^l: "Task Orientation" 


32.70 


33.61 


POCL-2: "Sociabil ity" 


\2.kl 


13.^6 



^Pbe-corapar?son group difference on this variable significant with 
p<. 10 (two-tai led) . 

Note: Table entries are group means: 



Table 10 
(cohtihUed ) 



eomparabi 1 I ty of Rernsirilhg PDC. arid Corripar 
on Baseline {Fall 1976) Character 



son Children 
sties : 



Samp?e Initially Tested in Spanish 



Sample Initial iy Tested In Spanish 








_ 

Fall 1976 test Scores 


?0C Sample 
Sprlnq 1979 


eomparison Sample 
Spring 1979 • 


E{ maxirmm) 




Z4 


■ 

BSP-Spanish 


1 — 

n .68 


11.46 


WPPSI 


7.^3 


6.85 


Verbal Fluency 


3.70 


5.00 


Verbal Memory- 1 


12.30 


13.24 


Verbal Membry-S 


2.28 


2.09 


Arm Coordination 


if. 37 


4.30 


Draw-A-ehild 


^.35 


4.59 


PIPS 


1 .78 


1.88 


POCL-1: "Task Orientation" 


30.81 


29.65 


POet-2: "Sociability" 


11.16 


11.24 



Note: Table entries are group means. 
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Table 11 



eomparab! 1 i ty of Remaining PDC and Cdmparlscih Children: 
■ Univariate and Multivariate Test Score Cbmparisdns of 
Pbe and eomparison Groups, by Language of . I n i 1 1 a 1 Test 
and Grouped Together (Full Analytic Sample)^ 









Fall 1976 Test Scores 


Language of 


Initial Test: 


Ful 1 Aria lytic Sample 


Erigl Ish 


Span ish 




Un i va r i ate Eompa r i son 


482 


70 


• SSI 


BSM-Ehgl ish 


n - u • 







BSM-Spanish 




n.d. 




BSM-botb tests 






n.d. 


WPPSI 


.02(e>p) 


n.d. 


'.65(c>P) 


Verbal Fluency 


n.d. 


n.d. 


n.d. 


Verbal Memory-1 


n.d. 


n.d. 


n.d. 


Verbal Memory-3 


n.d. 


n.d. 


ri.d. 


Arm Coordination 


n.d. 


ri.d. 


n.d: 


Draw-A-Child 


n.d. 


n.d. 


n.d. 


Pi PS 


n.d. 


n.d. 


n.d. 


p6cL-1: "Task Orientation" 


n.d. 


ri.d. 


n.d. 


Peet-2: "Sociabi lity" 


.003(C>P) 


n.d; 


.006(C>P) 


Multivariate Comparison 

N 


(96. 


65 

(92.9^=) 


528 
(95.81) 


Al 1 Tests Together: 
Significance 


.019 


n.d. 


:028 



liable entries are: n.d. if there is rio significant difference between PDC 
and comparison group :chi Idren ; or Sigriiflcarice level of difference and 
directidri as ct(P>e) where P: PDC group and C: comparison group; 
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As th^^abvles show^ there, are rid sigriif leant differences 
Between groups o"^ background characteristics^ There are, however, 
differences between groups on test .scores. . _For the sample of children 
initially tested ir^Engl ish, significant differences in entry-level test 
scores appear for th6^ Wt=^FSI and P0eb-2. Wh is more, differences 
between the PDC and coropari son groups show a consistent direction: 

for riirie of teri measureSN^ and both of the statisticaMy significant 

ones, absblutediffererices^ in entry-level scores favor the comparison 
group. A mul ti_yariate ariaK^sis of variarice appl ied to this sample 
confirms this finding, shbwit^g a_si§nif jcarit differerice between PDC 
and comparison groups at entrV. (F = 2.16, d.f.-^ 10^,^52; p = .020). 
No such difference appears for\he subsample of children initially, 
tested in Spanish. When both so^amples are combined (full arialytic 
sample) to test for a difference initiajleveU between treatment 
groups^ the flridirigs replicate thosfe for the subsample in[tial ly tested 
in English. There are multivariate differences between the two groups 
on entry-level test scores, with all differences consistently favoring 
the comparison group. Two tests show SKgriiflcant differences on 
univariate comparison: the WPPSI and th|\P0CL-2. Sample sizes for the 
multivariate comparisons range between 92 Xncl 961 of the total available 
samples for univariate comparisons. V 

In sum, fay spring 1979, attrition had af f'Sf ted the in i t ia 1 compara- 
bility of the_ treatmerit groups. This finding differs from findings at ^ 
entry and spring 1978. Al thbughthere has been nC^ significant change m 
the background characteristics of the two treatmerit, groups , they are no 
longer strictly comparable on entry-level test scor^. Further , there 
appears to be a definite directional tendency- to the difference between 
groups, with the comparison group higher on entry- leveKtest scores thari 
the PDC group. Differences between treatment group meanvleyels are not 
large (amouritirig to orie-quarter of a standard deviation oVy less), but 
they are consisterit. \ 

The implications of entry-level differences between grbufrs for child 
outcome analyses are not trivial. Covariarice adjustment for entry-level 
differences becomes necessary for the group iriitially tested in English, 
while such adjustment appears unnecessary for chi^rdreri iriitial ly tested 
in Spanish. The Issue of adjustment for entry-level differences between 
treatmerit groups is dealt with in Chapter V, where theanalyses of child 
outcome data for the spring 1979 analytic sample are discussed. ^ 

\ 

\ 

\^ 

Characteristics of the C[vi4<i-J 4easure s \. 

Table 12 provides a key to the abbreviated names of child outcome 
measures used in this report .Descr[ptions of the measures arid of the^ 
procedures by which summary scores are obtained can be found iri Apperidix A. 



\ 

\ 



\ 
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Table 12 



Key to Abbreviated Names of 
Child Outcbme Measures^ 



BSM-Engl ish 


English language version of the Bilingual 
Syntax Measure 


Donopan 1 sn 


^f^oriTch larifliiaflp v/pr^inri iriT fhe BllInGUSl 

Syntax Measure 


Verbal Fluency 


Verbal Fluency subtest of. the McCarthy 
Scales of. Children's AblHtles 


PI AT-Math 


Mathematics subtest of the Peabody 
Individual Achievement Test 


P 1 AT-Read 1 ng 


Reading subtest of the Peabody Indlvldaal 
Ach i evemen t Test 


PIPS 


Preschool Interpersonal Problem Solving 
Test 


POCL-1 


Task Orientation subscale of the Pupil 
Observat ion Checkl I st 


r u\j \^ 


^hrT^hllirv Subscale of the Pupil 
Observation Checkl 1st 


CRS-l 


Self-Assurance subscale of the Child 
Rat inq Sea le 


CRS-2 


Aggressiveness subscale of the Child 
Rating Scale 


eRS-3 


Dependence subscale of the Child Rating 
Scale 


ZRS-k 


Academic MotlvatTdri subscale of the Child 
Rat ing Scale ^ . 


CI-] 


Attitude Toward Teacher subscale (Part l) 
of the Child Interview 


el-2 


Interest In Reading subscale (Part 2) of 
the Child Interview 



■Child measures and summary scores are described in detai 



Appendix A. 



Score Distributions 



Table 13 presents ranges, meanSj medians and standard deviations 
of the surwnary scores for each child butciome measure included in the 
grade 1 (spring 197?) battery^ These statistics are computed for data 
based dri all PDC and comparison chi Idren in the anajyticsarnple. Score 
distributidris for each summary measure are graphically displayed in histo- 
grams appearing as Figures 3"1S* 
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As would be expected of measures sensitive to children's learning 
arid development, mean levels for the summary scores obtained dri more than 
one occasion between Head Start and first grade show i ncreases over time 
where apprdpriate. Table 1^ presents the mean levels and sample sizes 
available at all timepdirits for which the same instruments are administered 
as those used in grade 1 {spririg 1979). The data in this table exclude 
those children tested in English iri spririg 1979 who had been tested in 
Spanish on one or more occasions in previous years, since they in effect 
were not tested with the same instruments at all times. 

Andther perspective on score stabi Hty is provided_by summary score 
correlations between one testpoint and another, indicating the degree to 
which the relative pdsitidris of children's scores change over time. Table 
15 presents, again fdr those children for whom the same instruments were 
administered over time, the dccaslgri- td-occas ion correlations for each 
measure in the grade 1 (spring 1979) battery administered more than once. 



I nterrial Cdris i sterna 

Table 16 reports cdefficients of |nternal consistency (Croribach's 
alpha) for the summary scores of each measure in the spring 1979 battery. 
All but one of these coefficierits exceed the cr i teri^on of . 55 establ i shed 
as the cut-off for acceptable item hdmogeneity in previous reports. The 
single exception is the "atti tude_tdward teacher'' scale from part 1 of the 
Child Interview, for which a coefficient of .5^ was obtained for the sf* - 
sample at spring first grade. 



Since the Child Interview was not administered pridr to spring 1979, 
no comparison with cdefficients from previous PDC data cbllectidris is ^ . 
possible. When a slightly different version of the instrument was admin- 
istered to similar first grade children in a longitudinal study of Head 
Start impacts (see Appendix A, Attitude Toward Teacher), similarly low 
internal consistency was found. However, in the absence of test-retest 
findings indicating short-term instabJlity and in the absence of clearly 



Table 13 



Descfriprive Statistics for Spring Grade 1 (1979) 
Ghild Outcome Measure Summary Scores 



Measure 


Standard 

N Range Mean Median Deviation 


BSM-Engi ish 


546 1-18 12.54 13-78 3-03 


Verbal Fluency 


546 2-44 16.24 15-93 6.07 


PIAT-Math 


535 6-41 18.70 19-34 6.04 


PIAT-Reading 


516 5-46 22.82 23.63 5.74 


PIPS 


545 0-8 4.17 4.74 1.65 


PGet-1 

Task Orientation 


513 11=56 41.59 42.03 10-41 


POCL-2 

Sbc iabi 1 I ty 


513 3-21 14.96 ' 15-13 4.62 


CRS-1 

Se 1 f-Assurarice 


510 11-55 35.18 34.75 7.52 


CRS-2 

Aggressiveness 


521 4-20 10.06 10.40 3-62 


CRS-3 

Dependence 


522 2-10 5-47 5. 20 1.93 


CRS-4 

Academic Mbtivatidri 


517 3-15 9.75 9-78 3-18 


ei-1 

Attitude Toward Teacher 


544 1=5 2.30 2.35 0.68 


Ci-2 

Interest In Reading 


529 3-15 9.42 9.85 3.20 




Figure 3 

Distribution of Sjsririg Grade 1 (1979) BSM-Efigi ish Scores 



HISTOGRAM 
MIDPOINT 

I . 0000 
3.0000 
5.0000 
7.0000 
9.0066 

II . 000 
13.000 
15.000 
17.000 
19.000 



COUNT 



(EACH X= 5) 



1 +X 
3 +X 
& =FXX 

39 +XXXXXX 

63 •fXXXXXXXXxXXXX 

73 +XXXXXXXXXXXXXXX 

111 +XXXXXXXXXXXXXXXXXXXXXXX 

173 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

85 +XXXXXXXXXXXXXXXXX 

2 +X 



(iNTERUAt UieTH= 2.0000) 



51 



f 1 



Figure U 

Distribution of Spring Grade 1 (1979) Verbal Fluency Scores 



M'! Oi-OIKT t.CHJN I (EACH 5) 



^.'■■-00 ^ fXXXXXXXXXXX 

! r.voo ^ i.r>o +xxxxxxxxxxxxxxxxx^xxxxxxxxxxxxxxxxxx 

17*000 172 ixxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

22*000 87 fXXXXXXXXXXXXXXXXXX 

27.000 32 -fXXXXXXX 

32.000 12 fXXX 

:5Z>ooo ::v ix 

42.':'no i. -fX 
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Figure 5 



Distribution of Sjsfihg Grade 1 (1373) Sammary Scores 
for PIAT-Math Scores 



flISTDGRAH 

MiEiPOINT COUNT (EACH X= 5) 

6.0000 2 +X 

11.000 iOi +XXXXXXXXXXXXXXXXXXXXX 

16.000 195 +XXXXXXXXXXXXXXXXXXXXXXXXX 

21.000 144 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

26.000 57 +XXXXXXXXXXXX 

31.000 1? +XXXX 

36.000 13 1-XXX 

41.000 4 +X 



(INTERVAL UItitH= 5.0000) 
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Figure 6 



Distribution of _Spr] hg_Gracle . 1 (1979) Summary Scores 
for PIAT-Readihg Scores 



h Tin 'DINT r:riUNT (EAGM X== ^) 

r^* 0000 z f X 

1:0*000 17, fXXX 

i?:.eoo 42 +XXXXXXX 

:0 . 000 218 f xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

2:> 000 152 +xxxxxxxxxxxxxxx>:xxxxxxxxxx 

30.000 5? -fXXXXXXXXXX 

35.000 18 +XXX 

40 ♦ 000 7 -fXX 

if..<r)00 A +X 



( I NTEF<'v'Ai. U i; DTH-= 5 * 0000 ) 




5^ 



Figure 7 



i)istribution of Spring Grade 1 (1979) Summary Scores 

for Pi PS Scores 



HISTDGRfiM 
MIDPOINT 
6. 

1 .boee 

2.0000 

3.0000 
4.0000 
5.0000 
6.0000 
7.0000 
8.0000 



COUNT 

3 
34 
51 
lOi 
113 
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90 
29 
6 



(EACH X= 3) 



+XXXXXXXXXXXX 
+XXXXXXXXXXXXXXXXX 



+XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
fXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
fXXXXXXXXXX 
+XX 



(INTERyAb UIDTH= 1.0000) 
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Figure 8 

bistribation of Spring Grade 1 (1979) Summary Scores 
for Peeb-1 Scores 



ll^OOO 2 iA 

»<^*000 8 iXXX 

::i ^ovo 9 f XXX 

:;^6*6oe 36 fxxxxxxxxxxxx 

3 1*000 77 fXXXXXXXXXXXXXXXXXXXXXXXXXX 

3.<. . 000 70 f XXXXXXXXXXXXXXXXXXXXXXXX 

41.000 72 +XXXXXXXXXXXXXXXXXXXXXXXX 

46.000 78 FXXXXXXXXXXXXXXXXXXXXXXXXXX 

lil .000 74 fXXXXXXXXXXXXXXXXXXXXXXXXX 

S6 . 000 87 +xxxxxxxxxxxxxxxxxxxxxxxxxx^^ 

( TNTERyni.. tdlDTH:^ 5*0000) 
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Figure g 



Distribution of Spring Grade 1 (1979) Summary Scores 
for Paeb-2 Scores 

N=S13 



HISTOGRAM 



HIDPOINT COUNT (EACH X= 3) 

3.6666 A +XX 

6.0000 32 +XXXXXXXXXXX 

9.0000 55 +XXXXXXXXXXXXXXXXXXX 

12.000 111 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

15.000 9? +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

18.000 105 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

21 .000 107 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

(INTFRUAb yi£iTH= 3.0000) 
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Figure 10 



Distribution of Spring Grade 1 (1979) Sammary Scores 



for CRS-1 Scores 



HiSTriGRi'in 

i~1Ii:F-niNT CDUNl " (EIACH X= A) 
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Figure 11 



Distributibh of Spring Grade J _(i979) Summary Scores 

for CRS-2 

#=S22 
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Figure 12 

Distribution of Spring .Grade 1 (1979) Surrirriary Scores 

for CRS^B 



ri=S22 



I ! ,i, :vi nGRAH 
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blsbribution of Spring Srade 1 (1979) Summary Scores 

for CRS-4 



HISTOGRAM 






h I BPS i NT 


COUNT (EACH X= 5) 


3.0000 


17 


+XXXX 


5.0000 


32 


+XXXXXXX 


7.0000 


65 


+XXXXXXXXXXXXX 


9.0000 
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fXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
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79 


fXXXXXXXXXXXXXXXX 
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84 
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+XXXXXXXXXXXXXXXX 






(INTERVAL WIDTH= 2.0000) 
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Distribution of Spring Grade 1 (1979) 
Child Interview Part 1 Scores 

N=544 



111 crnuRAM 



(EACH 7) 



t.oooo 

2.0000 
3*0000 
'^.0000 



J:2\iXXXXXXXXK 

r^^? f'XXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

2 -f ^xxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

24 ^XX>CX 
1 ^x 

\ 

aMTF^RyAl^ WIDTHS l.OOCO) 

\ 
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DistribUtibn of Spring Grade 1 (1979) 
Chi id Interview Part 2 Scores 

N=529 



HISTdGRAM 



MIDPOINT 



COUNT 



(EACH X= 4) 



3.0000 
5 . 0000 
7.0000 
9.0000 

li.bbb 

13.000 
15.000 



36 +XXXXXXXXX 

27 fXXXXXXX 

79 +XXXXXXXXXXXXXXXXXXXX 

132 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

87 +XXXXXXXXXXXXXXXXXXXXXX 

119 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

49 +XXXXXXXXXXXXX 



(INTERVAL WiriTR= 2.0000) 



Table \k 



Means of Child Outcome Heasores Repeated. Over Time. and 

Administered in Spring 1979 for all Children^ Still Present in Spring 1979 



Fall 1576 

lull ' X / 




Spring 


1977 




Spring 1978 


Spring 1979 


1 Mil 








Men 




J- 










BSHngllsh ^80 9.00 


BSH-English 


163 


9.73 


BSM-Engiish 


m 


11.62 


BSH-Engiish 


ii8l 


12:5'* 


BSH-Spanish 67 11.57 


BSM-Spanish 


69 


11:72 


BSM-Spanlsh 


39 


12.87 


BSM-Spanlsh 


70 


li63 


Verbal Fluency kl] 6.13 


Verbal 


Fluency 




8.81 ■ 


Verbal Fluency 


kkS 


,1^.31 


Verbal Fluency 


2l8l 


16.56 


PIPS ^Ik 1.93 


PIPS 




m 


2.55 


PiPS 




3.68 


PIPS 


m 


k.lk 


POGL-l ^81 33.15 


POCL-1 






33^58 


POCL-1 


til ft 


37.02 


Dfiri -1 
rUlL"! 






POCL-2 m 12:93 


ruCL i 






13.25 


POCL-2 


k\k 


13:29 


peet-z 


^55 


15.01 




CRS-1 




399 


35.22 


CRS-1 


398 


3i85 


CRS-1 . 


^150 


55.20 




CRS-2 






1 1 .oz 


CRS-Z 




11 c:n 






10:13 




CRS-3 






5.80 


CRS-3 


kl] 


5.51 


CRS-3 




5.^2 


















CRS-it 


^53 


9.76 












PIAT-Math 


2|29 


13.23 


PIAT-Math 


ii72 


18.99^^ 












PIAT-Reading 


itl6 


15.25 


PlAT-Reading 


^57 


23.00 


















Cl-I 


1:70 




KEY: 
















CI-2 


2(61 


9.73 


POCL-1: "Task Orientation" 






















POCL-2: "Sociability" 






















CRS-I: "Self-Assurance" 






















CRS-2: "Aggressiveness" 






















CRS-3: "Dependence" 






















tt\J"'t: : HCdUCliia nwLivoi WM 

el-1: "Attitude Toward Teacher" 




















, el-2: "Interest in Reading" 




















' o 





















ERfc""fi.nrcxi.atelv 70 children tested in spring 1979 in English but who had been tssted In Spanish i 



Table 15 

Stability (Test-Retest Cdrrslations) of the' Child Heasures at Poor Timepoints: 
Fall 1976, Sprlh§ 1977, Spring 1978, and Spring 1979 




BSH-English 
BSH-Spanish 
Verbal Fljency 
PlAT-Hatha _ 
PiAt-Reading^ 

PIPS 

POCL-l: "Task Orientation" 
POet-2: "Sociability" 
CRS-l: "Self-Assurance"^ 
eRS-2: "Aggress iveness"'' 
CilS-3: "Dependence"'' 



m 




1$ -M .56 


;56 .^8 




.61 .i 


\k .58 .7^ 


.Ik .65 


m 


M .] 


!6 .25 .5^ 


:36 -M 


iu 






.60 


m 






.56 



4^ 


.37 


.IS 


.23 


111 


.39 


.15 


.28 


111. 


.ill 


.19 


.29 



.30 
.35 
.36 
.38 
.31 
.05 



.31 
'.35 
.35 
.37 
•:3i 
-.03 



.29 
.29 
.39 
.^7 

^\ 



^he PIAT was first aditiiiiistered in spring 197R. 

'The Child Rating Scale was not admim'stered in fall 1976; thus, test-retest coefficients can be 
computed only for spring timepolnts. 



b 



y 



Table 15 



Reliability of Child Measures : erbnbach*s Alpha 
(Internal Consistency) PDC Spring 1979 Data 



Measures 


Ful 1 Ana lytic 


bamp 1 e 


rOGN ^'^IVE'-LANGUA GE 






RCM-pna 1 T ch 
DDn LI 1^ 1 1 31 1 


542 


.75 


h 

BSM-Spani sh 


'90 


.82 


Verba 1 Fl uericy 


552 


.76 


LEAPUrnG ATTIWmS- 






Child Interview - Part 1 


5?? 




Chi Id Interview - Part II 


52$ 




SOCIAL^mOTTONAL 






POCL-1: "Task Orientation" 


52 7 


.9i» 


i?det-2: ••Sociability" 


517 


.89 


CRS-1 : "Self-Assurance" 


516 


.78 


CRS-2: "Aggressiveness" 


527 


.76 


CRS-3 : "Dependence" 


523 


.77 ' 


CRS-5- "Academic Motivation" 


523 


,91 



^Three Instruments are not Included: the Preschool Interpersonal 
Problem Solving Test and the Pea body Individual Achievement Test 
(Reading and Math subtests) do not lend themselves . to coinputatlon 
of alpha. 

^Texas, California and Connecticut only. 
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more effective measures of young children's attj tudes . toward school and 
teachers, it seems unwise to reject part 1 of the Child Interview but. . 
of hand. The component scales have been wlde[y used and have been judged 
to have at least face validity by many researchers and educators. Unless 
hew irifbrmatlbri cprries tb light clearly Indicating the ansuitability of 
the measure for the purposes bf this research, it is recommended that 
the ''attitude toward teacher'' scale be retained and the scores analyzed, 
keeping In mind that there may be mbre "noise" than "signal" for this 
particular measure's summary score. 

Cbrrelatibris Among Summary Scof^s^ 

Further documentat ibri bf the psychometric properties of the measures 
IS provided by intercorrelatibns bf all summary scores for che total spring 
1979 sample, In Table 17- 



Factor Struat-u re of Summ a ry Score s 

In fable 18, the relationships in the intercorrelatlon matrix are 
reduced to a smaller number bf cornmon factors for the spring 1979 child ^ 
outcome battery. The factor analysis was accomplished by a varimax rotation 
of the four factors identified through a principal components analysis as 
having eigenvalues greater than one. 

The factor structure is somewhat ambiguous, with several measures 
Ibading moderately (loading levels of .3 or greater) on more than one 
factbr. The prbportion of variance accounted for by the first three 
rotated factors is clbsely_simi lar , ranging between 16 and 19% of thf. ^ 
total variance. The twb POCL scales (Task Orientation anc Sociabinty) 
load heavily on the first factbr, while the CI-2 (interest in Reading) 
and the PIPS evidence more moderate loadings.. Three of the four CRS^ 
scales (Self--Assurance, Dependence and Academic Mbtivation) load heavily 
on the second factor. The BSM-Engl ish, PIAT-Math, and PjAT-Reading load 
strongly, and Verbal Fluency loads moderately, on the third factbr, 
suggesting that this factor might be interpreted as an index bf.general 
academic achievement. The C!-l (Att i tude Toward Teacher) and _CRS-2 
(Agaressiver.ess) evidence moderate to strong loadings on the fourth 
factor; the positive loadings bf these factors Ind icate "negative atti tude 
toward teacher" and '^greater aggressiveriess/competitlveness," respectively. 
Because several measures load moderately bn twb or more factors, inter- 
pretation of the factor structure. Is uncertain^ particularly if referred 
back to the intercorrelat ion matrix in Table 17. 



Table 17 

intercorreiations of Spring 1575 Child Heasures 



2 ■= ? 



^ J. .1. 



1 



hi 



gSH-ENGLISH 1.0000 ,2306 .3497 .3875 »16?6 a?3S .1151 .i?15 .0529 -.06^0 



(546) (546) (535) (516) (545) '513) (513) (510) (520) (521) '.oKS' 



VfRBAL FLUENCY .2306 1.0000 .3062 ;2243 ;2593 12575 .1716 .2140 .1343 -.0530 ".0?S: .192: 

(546) (546' (535) (516) (545) (513) (513) (510) (520) (521) (31^) (54-1^ 

FIAT-HATH .3497 .3062 1.0000 .5743 .1537 .3330 .1533 .2888 .0346 -.1950 .r^n -.0502 

(535) (535) (535) (516) (534) (503) (503) (499) (510) (510' m) ''Zh '51^'; 

a _ . _ 

F'IfiT-f;«DING .3875 .2243 .5743 l.QOOO .1031 .3580 .1743 .4008 -.0559 ^.26:'S .m') -.04:1 

t^) (516) (516) (516) (516) (486) (485) (432). (493) (494) (488) (515) 'XC- 



r:;-- .1676 .2593 .1537 .1031 1^0000 ;3231 ;2873 .1322 .0438 -.0777 .1609 .057? .12 

,S45) (545) (534) (516) (545) (513) (513) (510) (520) (521) (516) (544) (52' 

fiXIl .1935 .2575 .333'^ .3580 .3231 1.0000 .6509 .2562 .0443 -.0988 .2482 .O'^U 

{513) (513) (503) (486) (513) (513) (513) (482) (4.91) (49?) (489) (Sl3i 

pnCL2 .1151 .1716 .1583 .1748 .2873 .6509 1.0000 .0727 .1306 -.0213 .0462 -.0311 

(513) (513) mi) (486) (513) (513) (513) (482; (491) (492) (489) (513) 

PFS.i .1915 .2140 ;2888 ;4008 .1322 .2562 .0727 1.0000 -.1704 -.4394 .8360 .0095 

(510) (510) (499) (482) (510) (432) (482) (510) (505) (502) (500) (509) 

IP':.? ,0529 .1343 .0346 -.0559 .0489 .0443 .1306 -.1704 l.OCOO .3061 -.0917 .0221 

■'^] (520) (510) (493) (520) (491) (491) (505) (521) (513) (508) (519) 

.v.jS -.0530 -.1958 -.2628 -.0777 -.0988 -.0213 -.4394 .3061 1.0000 -.3764 -.0382 

(521) (510) (494) (521) (492) (^92) (502) (513) (522) (510) (520) 



;i) 



rp-:;; .i077 .mZ .2786 ;4040 ;1608 .2482 .0462 .8360 -.0917 ■ -.3764 1.0000 .0344 

!5t6) (505) (488) (516) (489) (489) (500) (508) (510) (517) '515) 



•";iS) 



(il.l -.0561 -.0232 -.0502 -.0421 .0572 .0011 -.0311 .0095 .0221 -.0882 .0344 1.0000 -.0766 

: (544) (544) (533) (515) (544) (513) (513) (509) (319) (520) (515) (544) (5.:'?) 

• L'. .1814 .1923 .2794 ■.,3789 .2126 .4222 .2406 .2624 -.0159 -.1193 .2455 -;075S l.O^J'^ 

:^U^ (529) (529) (519) (502) (5.?9) (499) (499) (495) (505) (SOSi (5?< M^'* 



Table 18 



Factor Analysis^ of Scores pri Child Measures 
Spring 1979 













N= 425 


Factor Loading of Child Measures 

(highest loading italiaized) ■. ' ■ ■ 


Chi Id .Measure 


Factor 1 


Factor 2 


Factor 3 ■ 


Factor k 


BSH-Ehglish 


.03 


.05 


.7S 


.02 


Verbal Fluency 


.29 


.05 


.41 


.37 


^ PIAT-Math 


;15 


.25 




.08 


PIAT- Reading 


.18 


.36 


.69 




PIPS 


.55 


.16 


.03 


.35 


POCL-1: "Task Orientation'' 


.84 


.13 


.22 


.0\ 


Peet-2: "Scciability" 


.86 


-.08 


.Oi* - 


-.02 


Cl-2: "interest In Reading" 


.48 


.22 


.35 


-.r; 


CRS-1 : "Self-AssUrance" 


. 10 


.83 


.26 


-.05 


eRS-3: "Dependence" 


-.08 


-.71 


.02 


.22 


CKS~H: "Academic Met! vat ion" 


.09 : 


.82 


.22 


.15 


■CRS-2: "Aggressiveness'- 


.03 


-.39 


.18 


.68 


ei-1: "Attitude Toward Teachert' 


-.06 


:31 




.52 


% of Total Variance 
Accounted For 


V6.k 


1^.5 


16.2 


8.6 



^Principal components solution, varimax rotation. 
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R. . ^itlOA-s^ip of Hgasares to "Socla-1 Eompetance' ' 



As !h analyses of spring 1977 and IS78 data, the relationships^ of 
tesi scores to a set of measures established as proxy criteria for "social 
competence" were exam i ned . The sbc la ] competence cr iter la cons i sted of 
the two subscales of the POCL ("Task Or ientat ipn"_and "Sociability") and 
the four subscales of the Child Rating Scale ("Sel f-Assur£hce: " "Aggressive-, 
ness," "Dependence" and "Academic Motivation"). These measures were selected 
In Phase I as indices of social competence because they appeared to tap 
a broad range of characteristics — social, emotional, cognitive, Ijngaistic, 
and psychbmbtbi — that contribute to chi Idren' s everyday effect iveness as 
judged, in this instance, by the i r teachers arid testers. Given the state- 
of-the-art of conceptual Izat ibn and measurement bf sbclal competence, the 
criterion measures selected can provide, of cburse, only a crude estimate 
of the construct of interest. 

The analytic design involved partitKning the variance in spring 1S79 
tesl scores into two parts: first, that part explained by demographic 
characteristics of the children (age, sex, and etnnicity); second, any 
add i t iona 1 variance accounted for by the complete set of social competence 
indices. It is hypothesized that the strbnger the relationships of teit 
scores to indices of social competence _ (oyer and above demographic factors), 
the more relevant tbese scores are as indices of program impact- 
All of the test scores were fcand to be signif ican::ly related to the 
set bf social competence crit^^rla over and above any relat io.^shjp to da-no- 
graphic factors, as can be seen in Table 19. The s rcrirjest relationship 
was found fo- the P I AT-Readi hg (22/ bf variance explained) ; the sectkest, 
for the BSM-English (only 5^ of variance explained). 
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Table 19 



Relationship of ''Social Gompetence" Criteria and.Backgrdurid 
Variables to Test Scores of First Grade Children 



Test 



BSH-English 



Verbal Fluency 



PIAT-Math 



PIAT-ReadIng 



% of variance accounted 
for jointly by "social 
cbmpetehce" criteria 5 
background variables 



.19" 



:11* 



.29^ 



I of variance accounted . 
for by "social competence" 
criteria beyond background 
variables 



.27^ 



.22-^ 



■'^Prdbability of associated F ratio <_ 



Signl f leant ^'jdictors 
(p<.05) S their partial 
correlations with test 
scores 



Variable 
Ethnicity 

pecb-i 

CRS-1 



POCL-1 
CRS-2 



Ethnicity 
POCL-1 
Age 
eRS-3 



POCL-1 

Ethnicity 

CRS-3 



POCL-i: "Task Orientation" 

POC "Sociability" . , 

GRS "Self-Assurance" 

CRS-:. "Aggressiveness" 

CRS-3: "Dependence" . 

CRS-i: "Academic Motivation" 



3^1 
.16 

.13 



.25 

-.13 
-.11 



-J? 
-!l3 



V 
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V 

EXAMINATION OF OUTCOMES FOR CHILDREN 



This chapter focuses on analyses deaU ng wi th ch i 1 d^l evel butcome _ _ 
measures for grade 1 . It includes three major sections, dealing successively 
with three research questions: 

• What are the impacts of PDC bri children at the ^nd of grade 1? 

m What IS the relation of measures in bther study dbmaihs to child 
outcomes, irrespective of the educational treatment? 

• Tb what extent do study measures in other domains help explain 
treatment-related differences in child outcomes? 

Because of the length a:nd complexity of the answers to these questions, 
a summary of the ^'Jndings of analyses related tb these questions appears 
separately ab ^'.Ji^zer Vl of this volume. 



Evidence bf PDC's Impa ct on Chil d ren 



There are many aspects to the question "What has PDC's ^mpact on 
children been?" These differing aspects imply various strategies in 
analysis and interpretation of project data^ The purpose of these 
strategies is to set pribrities in answering questions, to isolate potentialW 
confounding factors, and tb assess the merits of different responses^ 
to the main question. The aspects cons i dered in designing an analytic 
approach to the PDC child outcome data have Included: 

• For what measures of child outcome, or for what aggregates 
or constructs of different measures, are effects to be 
assessed? 

• Has the prbgra-.'s Impact differed by site? 

• What have been the effects bf sample attrition on the 
comparability of PDC and comparison samples, and what 
effect does this have on outcome assessments? 

• Have program impacts differed for children of differing 
dcmb§iV3phIc cr background characteristics? 

:>w have prbgrarh impacts differed over time? 
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Overview of the Child impact Analytic Design 

The basic analytic design for assessment of child impacts employs 
both univariate and multivariate analyses of variance and covariance; 

In answering the main question, *'What is the impact of PDC on chftdrer: 
to date?", five specific questions are posed. The first two of these are 
understood as prel iminary to the last three, which are roughly parallel to 
one another and explore different aspects of the answer to the questions. 
Ac^.will be shown below, the last three questions also refer to somewhat 
different samples of children. Figure 15 relates the five questions 
regarding child Impacts to a sequence of decisions about analyses and 
describes the specific analytic design used in addressing each. The five 
questions are: 



1. For the children t'ested in spring 1979-^ are groups 
comparable oh entry-level (fall 2976-> data? 

2. Is tnere a rel:ztion between child background aharacterisiics 
ard prograr: ef feats — in particular^ are there program-by- 
background inl raciio'^s? 

3. Looking at child outcome variabl'es for spr*ing 1979 only and 
considering outcome variables one at _'a time-^ are there 
effects of vrogran^ or program-by -rite interactions? 

*4 - LfC'OKZ'na at- child outcome variahles for spring _ 1979 only and 
considering all of them simultaneously^ are there program 
effects or program-by-siie interactions? 

5- Considering all possibte occasions for each child outcome 
var-iabVe meast ed in spring 1979^ are there trends and. 
patterns ove^ ^ime in program ov program-by-site 
intera^ytioyis? 

Vari ables used in child outcome analyses . T^ri' following sets of 
variables vvrere incorporated in one or more of the analyses discussed in 
this section: 

I diepeiiden t var i abl es : 

program conditions (two) 
s i tes (el even) 

Child background characteristics : 

sex. ( two 1 evel s) 
prior preschool experience (two levpJs) 
ethnic i ty (five level s) 



Figure 16 



Seqaence of. Research Questions and Aiialyses In the Examination of 
Child-Level Impacts at Grade 1 and Earlier tevels 



Questions 



Decisions 



Are the two groups 
comparable on 
entry-level data? 



If the .answer is no: 
Identify variables 
to use as covarlates 

\~4 in UlVy- 



If the answer is yes: 
No action necessary. 



.Analytic 
Procedures 



Multivariate 
one-way 
analysis of 
variance, 
simultaneous 
on entry- 
variables 



Number of 
Analyses and 
Sample Sizes 
(for sample 

tested In 

English) 



n^i}63 



Dependent 
Variables 



Independent 
Variables 



FalM97S: 
3Sfl=EngiIsh 
Verbal Fluency 
V; HeiTiory-l 
V; Hemory-3 
PIPS 

POCL 1 S 2 
«PPSI 

Arm Coord. 
Draw-A-Child 



CdvariatfeS- 



Proaram 



None 



is there a relation 
oetween child char- 
acteristics and 
program effects 
(e.g., group-by- 
sex interactions)? 
L_ 



If the answer is no: 
Child characteristics 
variables can be used 
as covarlates In 



If the answer Is yes: 
Separate adjusf^snts 
required by group for 
child characteristics. 



Multivariate 
four -way 
analysis of 
covar lance, 
repeated 
measures 
across 
occasions; 
One analysis 
for each 
dependent 
variable. 



10 



n occasions : 
BSM-English; 
P0EI: I £ 2; 
PIPS; Verbal 
Fluency 

3 occasions : 
CRS 1-3 

2 bccaslofri : 

■P!AT-Hath. 

PIAT-Reading 



Program 




MPPSI 


Sex 




poet-2 


Ethnicity 




[Fall 


Prior- 




1976) 


Preschool 


1 





£.'1 



Figure 16 
(continued) 



(Questions 



^Analytic 
Procedures 



Analyses. and 
Sample Sizes 
(for sample 

tested in 

English) 



Variables 



Independent 
Variables 



Eovari-atfii 
(for sample 
tested iii 
English) 



For spring 1979 out- 
comes (taken one at a 
time), are there group 
or group-by-site 
effects? 



Univariate 
two-way 
analyses of 
cbvariarice. 
One analysis 
for each 
dependent 
variable. 



13 

n=.... 



.J 









BSH-English 




Program 


Verbal fluency 




Site 


PIAT-Math 




Dominant 


Pi AT- Reading 




Language 


PIPS 








POCL 1 £ 2 




CI 1 5 2 




CRS 1-^ 






For spring 1975 out- 
comes (taken sloiul- 
taneoDSiy) , are there 
group or group-by- 
site effects? 



Hultlvariate 
two-way 
analysis of 
covariance. 



n=376 



Variables as 




Variables 




Variables 


for 




as for 




as for 


0.3 




Q.3 
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For all occasions: 




Huitivariate 


13 


are those patterns 




two-way 


over time In group 




analysis of 




or group-by-site 




covaricnce. 




effccLs'j 




Gne anaiysls 








for each 






dependent 






variable 






across 






otCdSions. 






Variables 
as for 




■Entry- 1 evel variables : 



BSM-Ehgl jsh 
BSM-Spanish 
WPPSI 
Verbal Fl uency . 
Verbal Memory 1 
Verbal Memory 3 
PIPS 
Draw-a-Chi Id 
Arrri Coord \ hat ion 
POCL-1 
POCL-2 

Dependent variables : 

BSM-English (four occas ions) 
BSM-Spariish (four occasions) 
Verbal Fluency [four occasions) 
PIPS (four occasions) 
POGL-l (four occasions) 
Pdeb-2 (four occasions) 
CRS-l (three occasions) 
CRS-2 (three occasions) 
CRS-3 (three occasions) 
PiAT-Math (two occasions) 
PIAT-Readihg (two occasions) 
CRS-M (one occasion) 
Child Interview 1 (one occasion) 
Child Interview 2 (one occasion) 



Preliminary Arialysesr Quest ions ^^nd 2 

in order to formulate appropriate analytic designs for assessing 
child outcomes in response to questions 3 through 5, It was first necessary 
to address questions 1 arid 2. 

Question 1: Were PDC and cornparispn ohildren vmaining in the 
temple at the end of first grade tsprins 1^73) 
oomparabie at entry (fall 1975)? 

Findings , The methods used to address thi5 ' »on and the findings 
hive already been described indetail in Chapter \ :e in particular 
Table 16). We reiterate the findings here in su' ■:• • ^r.Ti: 

# For the sabsample tested at entry, [ri Engl ; .n=^8e) , 
significant differences between PDC and comparison 
children were found for two of ten ^ntry-l^eve^ measures: 
WPPSI arid POCl-2. Absolute differences between group means^ 
favored the cdmparison group in nine of ten instances. Kulti- 
variate analysis of variance considering aU ten entry-Ieve] 
measures simultaneously confirmed the univariate ANOVA findings. 
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• For the subsample tested at_eritry ?h Spanish (ri=7l), no 
significant entry-level differences between PDC and 
comparison groups were found in either univariate or 
multivariate analyses of variance. 

An a lytic design implic ations . The findings for question 1 had 
important impl ications for the analyses that followed. Firsts the discovery 
of entry-lisvel d I ffererices between PDC arid cbTparison children tested in 
Eriglish mearit that spring 1979 outcome comparisons vvere likely lo be 
biased. In favbr of the comparisbri group unless outcorr' variable variance 
resulting from initial differences could be removed- Therefore, a decision 
was made to covary outcome varlaoles on entry-level WPPS I and POcL-2 
scores (the only two entry-level variables significantly differentiating 
groups) in all subsequent analyses for the sample Initially tested in 
English. The adequacy of the analysis of cbvarlarice approach taken here 
to cbmperisate for iriitial PDC/cbmpar I sbri d I ffererices _wi 1 1 be considered 
Iri a later section, where we interpret statistical findings related to 
questions 3 through 5- Second, the decision to make covarianc3 adjustments 
of outcome r-rr.asures for the sample Initially tested in English made it 
impractical, If not impossible, to analyze data for children initially 
tested in Spanis:; together with data for those tested in English- Because 
Spanish and English versldns of entry-levei measures cannot be assumed 
to measure the same constructs, arialyses of the cbmbiried samples would 
have required separate cpvarlate adjustments for childreri in the two _ 
grbups--mak i ng analytic designs even more cbmplicated arid raising additional 
questions about I n terpre tab i 1 i ty . Consequently, it was decided that all 
analyses of outcomes would be performed separately fcf J- '"'•'^■^ tested 
initially in Spanish and in English. 

Q4jes-U^ on 2 : Is there a relationship between child backai^und 
chardcteri'stic's and vrogrcjr, eff'ects — i-e-j 
there group -by -backgratmd interactions? 

Method of analysis .. Eachoutcome variable was conslcered separately 
iri repea rd measures anal yses incorporating all occasions oF measurement 
of that /cr/iable from fall 1976 through spring 1979- the repeated measures 
analyses ..:^re performed using multivariate, rather than univariate, analysis 
of vari.-'-- techniques in order to circumvent assumptions of conpound 
symmetr '-^n, 197A). The analytic design incorporated ma'n ef-^^ects of 
group ^'x - lor preschool exper i ence , and ethn I c I ty ( Engl i sh - 5. L^H 
samp" J - i ■ , ; eparate first-order iriter^ctlbrj of group with se^, prior 
pre , Ov-^l, anc thn i c i ty _ (Eng 1 i sh- tes ted_ samp] e bnly); pooled h'gr.er-brder 
int : -acr. :-,s ; d entry--level WPPS! and POCL-2 as covariates for ':he_sub- 
sarJc initia' y tested in English. The number of measurements available 
ranc- : ^ror. e to four depending upon the variable; for measures administered 
only or , , univariate approaches were used. Analytic sample si^^s differed 
somewhat across variables due to missing data. 
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Firidirigs . Table 2b samSarlzes the tests.of .first-order Interactions 
fdr the sampie initially terted tn English. Pooled hi§her-brder inter- 
ictibns were ::ested but not interpreted because of their complexity and _ 
because they are of little a priof^ interest at this stage of data analys'S. 
A number of first-order interactidnc reached statistical significance; 
however, no consistent pattern emerged. And when the three significant 
§rbup-by-ethnicity interactions were compared within the multivariate 
repeated measures analysis of variance framework, they were found to have 
rather different characteristics- When "ana 1 yses were performed on data 
for children i h i t ial 1 y tested in Spanish, no significant first-order 
interactions were found. 

analytic design implications . Prior to addressing question 2 \t was 
decideFThaTTnteraction terms should riot be incorporated in analytic 
designs for questions 3 through 5 unles-. there were compelling reasons^ 
to dp so, because to include these terms as independent variables wouid^ 
entail estimating variation for an extremely large number of design cel. s, 
rTK)st of which would have few or no subjects. Under these circumstances it 
^^u'c 0- :~DOSsible to obtain consistently reliable est imates of wi th i n-ce] ] 
variance, and the i nterpretabi 1 i ty of the entire analysis would be jeopar- 
d ized. 

Tests of first-order interact ibris of group membership wi th ^background 

characteristics did not reveal strong, consistent interaction effects. 

Thus, we concluded that these interactions could be disregarded m subsequent 
an-;yses and that the background characteristics of sex, prior preschool 
experience, and ethnicity could ce incorporated as cdvariate-s rather than 
ctesign factors. 

AnaJ^^^es-O^Ehi Id Outcomes: Quest i oris- 3^,-^^^—aod- 5 

The analytic designs used to address questions 3 through 5 all involve 
Miustments of dependent variables, for entry-level WPPS I and Peet-2 _ 
differences between groups (in the case of childreri initially tested in 
Enqlish) .-^nd for the main effects of sex, prior preschool experience, and 
(in the case of the sample tested in Engiish) ethnicity. Because tests 
of the group main effect arid the group-by-site interaction are performed 
on adjusted rather than observed scores, it is useful to examine mean 
ad-justed scores for each dependent variable as well as the observed score 
means Figures 17a through l8d graphthe adjusted means for each occasion 
of measurement for each dependent variable by program group and language 
of initial testing. Tables 21 and 22 present both adjusted and observed 
mean values for each variable at each timepoint by group and language or 
initial testing. 

The data presented in Figures 17a through l8d and Tables ?^^nd 22 
apply strictly to the samples of children for whom scores were_ --^ta i ned 
at ail occasions of measurement bf the variable in question. ^T. ese are 
the sa.pies analvaed in addressing ques t ion 5 .. .The rel at i onsS os between 
these samples and the samples of. analyses addressing question; J ^"^J are 
illustrated :n Table 23, which lists the sample sizes for e^c. analysis and 
d ep.eiid erit va r i a b 1 is 
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Table 20 

pstion 2 Findings: .Summary, of Tests of Interactions 
• of Group with Ethnicity, .Sex, and Prior Preschool 
Experience for Sample Tested iri English 





Dependent Variables 


BSH- 
English 


PIPS 

m 


POCL-1 
n=356 


POCL-2 
n=356 


Verbal 
Fluenc 
n=ii2- 


1 ■ ■■ 

1 








PlftT- 


PIAT- 

Read 

n=398 


CI-1 


CI-2 
n460 


^ 


CRS-2 
n=35S 


CRS-3 
n=355 


CRS-^ 

n=il52 


Ha.th 
n=il2^ 


Group-by 
Ethnicity 


P<.OS 




> 




P<.Ci 


















Group-by- 
Sex 


1 ■ 

! 


P<.D5 






- 


















Group-by- 

Prior 

Preschool 










1 


; p-i 










p<.05 
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Figure IJa 



Plot of Adjusted PDC arid. Cppri son Grdiip Means dri Measures in the Fall 
Head Start, Spring Kindergarten and Spring Grade 1 Batteries 
(Sample tested in English) 
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Note: Each of the means plotted is adjusted ^or the effects of entry-level differences and 
differences In background characteristics. Residuals are readjusted to raw sonmary 
score value ranges by adding baci( overall sample means: Cases used for these plots 
are those with complete data for all timepoints. 



Figure 17b 

Plot of Adjasted PDC and Comparison Sroop Means on Heasares in the Fall 
Head Start, Spring Kindergarten and Spring Grade 1 Eatteries 
(Sample tested in English) 
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^'^ Note: Eacli of the means p .'ted is adjusted for the effects of entry-ievel differences and 
differences in back, "jrd characteristics. Residuals are readjusted to raw summary 
score value ranges L icJing l)aci< overall sample means. Cases used for these plots 
ErJc ^^^^^ ^'^'^ compltu cata for all timepoints. 
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Fi§iire 17c 



Pit of Adjasted PDE and Ebipariso'n Group lleans on Measures iri the; Fall 
Head Start, Spring Kindergarten and Spring Grade I Batteries 
(Sample tested In English) 
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Note: Each of the means plotted is adjusted for the effects of entry-level differences and 
differences In background characteristics. Residuals are readjusted to raw summary ■ 
score value ranges by adding back overall sample means. Cases used for these plots 
are those with complete data for all tlmepolnts. 
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plot of Adjusted PDC and Comparison Groap Means on Measores in the Fall 
Head Start, Spring Kindergarten and Spring Grade i Batteries 
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_ Note: Each of the means plotted Is adjusted for the effects of ehtry-level differences and i ij j 

differences in baclcground characteristics. Residuals are readjusted to raw suttimary ^ 
score value ranges by adding back overall sample means. Cases used for these plots 
are those with complete data for all timepoints. 
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Figure l/e 



Plot of Sdjusteci.PDC and Cdniparisbn 
Head Start, Sprlng.Klndergarten 
(Sample tested 



GrDufJ Means on Heastires in the Fall 
andjpring Grade 1 Batteries 
in English) 
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Note: Each of the means plotted is adjusted for the effects of entry-level differences and 
differences in background characteristics. Residuals are readjusted.to raw summary 
score value ranges by adding back overall sainple ineans. Cases used for these plotl 
are those with cwnplete data for all tiffiepoints. 
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Figure I8a 



Plot of Adjusted PDC and Comparison Group Heans on Measures !n the Fall 
Head Start, Spring Head Start, Spring Kindergarten and Spring Grade I Batteries 

ISample tested In Spanish at Entry) 



N (PDC) -11 N[CoipQpiionl«21 N(PDE)»17 H (eoiportiohl «22 




Foil Spring Spring Spring Fott Spring Sprthg Spring 

HiQd Slort Klnd»rgorttn Hied Start Ktndargortin 

Hiad Stdrt Flrit G.-odi Htod Stort Flr«t Grodi 

BSR SpontsH Verbal Fluency 



• _ _ _ _ 

Note: Each of the means plotted is adjusted for the effects of differences in background characteristics. 
Res'^oais are readjusted to raw summary score value ranges byjddlhg back overall sample means; 
Cases used for these plots are those with complete data for all tlmepoints. For the CRS-1, CRS-2, 
eRS-3 and BSM-English instrtiments, Insufficient samples are available over time for analyses. 



Figare l8b 



Pibt of Adjusted PDC and Comparison Group Heans on Heasares in the ^al ' 
Head Start, Spring Head_Start, Spring Kinc'ergarten and Spring Grade 1 Batterle' 

(Sample tested in Spanish at Entry) 
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Note: Eacii of the means plotted Is adjasted for the effects of differences in baci<(jround characteristics. 
Residuals are readjusted to raw summary score value ranges by. adding bacl< overall sample means. 
Cases used for these plots are those with complete data for aJI timepoints. ForjHe CI^S-1, CRS-2, 
CRS-3 and BSH-English instruments, insufficient samples are available over time for analyses. 
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Figure 18c 



Plot of Adjusted PDC and Comparison Group Heans on Heasures in the Fall 
Start, Spring iiead Start, Spring Kindergarten and Spring Grade 1 Batteries 
(SatPple tested in Spanish at Entry) 
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Note: Each of the means plotted is adjusted for the effects of differences in bacl<ground characteristics. 
Residuals are readjusted to raw summary score value ranges by adding back overall samjjle means. 
Cases used for these plots ar"e those with complete data fbi' all tiiiiepoints. For the CRS-1, CRS-2, 
CRS-3 and BSM-English instruments, insufficient samples are available over time for analyses. 
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Plot of Adjusted PDC and Comparison Group Means on Measures in the Fall 
Head Start, Spring Head Start, Spring Kindergarten an(t_Spring Grade 1 Batteries 

(Saitiple tested in Spanish at Entry) 
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Note: Each of the means plotted is adjusted for the effects of differences In bacl<grbund characteristics. 
Residuals are readjusted to raw summary score value ranges by adding back overall sample means. 
Cases used for these plots are those with complete data for all timepoints. For the CRS-1, CRS-2, 
CRS-3 and BSM-English instruments, insufficient samples are available over time for analyses. 



Table 21 

Observed and Adjusted*^ Means for PDC arid Cbrhparisbh Groups 
By Occasion: All ehtld Outcome Measures; 
Sample Tested Initially in English 



Var- lable 



BSM-Engi rsh 
Observed 
Adjusted 

PIRS- 



Observed 
Adjusted 

Pbeb-1 



Observed 
Adjusted 

pmt-2 



Observed 
Adjusted 

Verbal Fluency 
Observed 
Adjusted 



Observed 
Adjusted 

Observed 
Adjusted 

CRS^ 
Observed 
Adjusted 



Group 



PDC 



Occasion 
12 3 ^ 

FHS SHS SK SGI 



(n) 



8. 


77 


9-65 


11 .it6 


12.29 


9. 


05 


9-93 


11. 6i) 


M.M2 


1 . 


86 


2.k7 


3.69 




1 . 


96 


2.55 


3.71 


4.32 


31. 


60 


33.1^ 


36.10 


i+1 M 


32. 


80 


33.89 


36.59 


i+l .85 


12. 


1 1 


13.00 


13.06 


lit. 67 


12. 


21 


13.09 


13.17 


1^4.75 


5. 


95 


8. MS 


]h. 1.1 


16.38 


6. 


31 


8.82 


lij.i+O 


16.53 



(223) 



(220) 



35.91 


35.02 


35. 


54 


35.02 


35.06 


35. 


47 


V\M 


10.86 


10. 


04 


11.63 


1 1 .02 


10. 


1 1 


5.80 


sM 


5. 


69 


5.77 


5.42 


5. 


69 



(196) 



(213) 



(215) 



9.31 
9.01 

1.97 
1.85 



Comparison 



Occas i on 
1 2 3 5 

FRS SHS SK SGI 



(n) 



9.81 
9.51 

2.70 
2.61 



11.84 12.85 ,^wo\ 
11:65 12.71 ^2°^^ 



3.70 
3.68 



4.24 
4. 19 



33.62 34.06 37.48 41.95 
32.33 33.27 37.07 41.4? ^ 



13.46 13.52 13.77 15-45 
13.35 13.43 13.66 15.35 



6.18 9.27 14.47 16.74 f-nt) 
5.80 8.87 14.16 16.58 



35-11 35.33 34.39 
34.98 35.27 34.38 



12.18 11.87 
11:95 11.63 



9.73 
9.64 



(143) 



5.92 
5.96 



5.51 
5.51 



5.20 

5.21 ^ ^ 



iAdjusted means are obtained as residuals of regression equat 1 ons Jor - each child 
outcome as dependent variable, using as predictors entry-level valuesforWPPSI 
and POCL-2, as well as dummy " variabl es for sex, prior preschool expert 3nce and 
ethnicity. Residuals are adjusted by the addition of overall means for each 
occasion. ; - " 

_-THe Sample' represented in these data is the sampleof chHdren with complete 
"data for all occasions of measurement for a given instrument. 
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Table 21 . 
(continued) 





• . Group 




PDC 


Comparison 


Variable 


Occasion 

12 3^ 
THS SHS SK SGI (n) 


Occasion 
i 2 3 h 
FHS SHS SK SGl (n) 


Observed 
Adjusted 

PI AT- Reading 
Observed 
Adjusted 


12.88 18.62 ,,,^v 

13.09 18.83^ 

12,. 70 22. 18 

14.71 22.56 ^ ' 


_-^__ ..... 13.53 19.56 f 
_____ 13.27 18.86 

....^ 15.79 25.89 moo. 
____- _-_^_ 15.26 23.2fl 


CRS-U 

Observed 
Adjusted 

Child 

lriterview-1 
Observed 
Adjusted 

Child 

lnterview-2 

Observed 
' Adjusted 


::::: (230) 
::::: ::::: I'M 

_____ 9.62, . 

_____ _____ 9.69 ^^^^^ 


9.57 .^^^^ 

9.56 

..... 2.33 (233) 

2.32 

9.83 (225) 

9.77 



Table 22 

Observed arid_Adj usted^ Mearis. for PDC arid Cbrriparisbh Groups 
By Occasion: All Chi Id _ Outcome Measures; 
Sample Tested Initially In Spanish 



Variable 



BSM-Sparii sh 
Obse rved 
Adjusted 

PIPS 



Observed 
Adjusted 

POCL-l 



Observed 
Adjusted 

POCL-2 



Observed 
Adjusted 

Verbal F^luency 
Observed 
Adjusted 



Group 



PDe 



Occasion 
1 2 3 " ^ 

FHS SHS SK SGI 



(n) 



12.50 13.21 13-79 15.07 
]2.k0 13-15 13.69 15.11 



i^h) 



2.12 2.29 3.Z6 3.18 /,^v 

2.15 2.25 3.81 3.38 ^ 

30.93 39.1^ 37.21 ,,vv 

29:52 37-99 35.99 35.02 



11.64 13.71 li».07 13.21 /.v^ 
11.20 13.57 13.9i» 12.55 ^ ' 



i|.06 ,J^S 10.59 12.76 f,^. 
i».09 7-^5 10. 5^ 12.69 ^ 



Compar i son 



Occas ion 
1 2 3 

FHS SHS SK 



SGl 



(n) 



11 .90 12.10 12.10 li».38 
11.96 12.12 12.15 1^-35 



1.97 
1 .85 



3.43 
3.i»7 



3.61 
3.57 



i».00 
3.85 



(21) 



(23) 



28.78 3^.00 3^-78 i»3.83 f,o> 
29.88 34.90 34.96 44.15 ^ ' 



1 1 .28 12.eL_t2-^ ■ 15.83 
-.,1,1^2-12:72 12.99 16.35 



(18) 



4.68 7;68 8.27 13.82 >„s 
4.65 7.83 8.31 13-88 ^^^^ 



eRS-1 



Observed 
Adjusted 

eRS-2 



Observed 
Adjusted 

CRS-3 



Observed 
Adjusted 



SAMPLE SIZE TOO SMALL FOR ANALYSIS 
SAMPLE SIZE TOO SMALL FOR ANALYSIS 
SAMPLE S J. Z_£ T 0 0^ SMALL FOR ANALYSIS 



^Adjusted means are oHtained as residuals of regress ion. eqaat-rons for each chil d 
outcome as dependent variable^ using as predictors dummy variables for sex and 
prior preschool experience. J^esiduals are adjusted by the addition of overall 
means for each occasion. 

The sample represented in these data is the^ sample of children with complete 
data for all measurement occasions for a given instrument. 
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table 22 
(continued) 



Variable 


Group 


PDC 


Comparisbri 


Occasion 
1 2 3 ^ 
FHS SHS SK SSI (n) 


Occas ion 
1 2 3 ^ 
FHS SHS SK SGI (n) 


PIAT-Math 
Observed 
Adj usted 

PIAT-Readirjg 


13,38 16.67 

— — - 13.30 16.31 

13.90 20.53 ng) 

13,78 20.^7 ^ 


13.00 17.27 

_____ _____ 13.05 17.55 ^^^^ 

,1.56 23.87 (23) 

11.65 23.91 


Observed 
Adjusted 


Observed 
Adjusted 

Child 

lnterview-1 
Observed 
Adjusted 

Child 

lnterview-2 


::::: ::::: ::::: '^i (37) 

- 

_-— = 2.38 y^js 
_____ _-_-- 2.35 

7.22 


___.._ ___^- _____ 8.79 ?33^ 
__-_- -__-- _-__- 8.83 

_____ _ 2.11 ,33^ 

_.=-= ..__^ _____ 2.14 ^^^^ 

_____ 7.32 . , 

_„__ _____ — __ 7.25 


Observed 
Adjusted 



V. 
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Tab]3 23 

Comparison of Sample Sizes Available for Analyses 
Addressing Questions 3, ^ and 5, by Child Outcome Measure 
for Sample Tested in English and (zt Entry) in Spanish 



Measure 


Sample 


"■^sted in Eng 
n = 480 


isf- 


Sample Tested in 
n = 71 


Span i sh 


3 


dues t ions 
4 


5 


3 


Quest i ons 
4 


5 




BSM-Eriglish 


m 


376 


431 


70 


SI 


SI 


BSK -Spanish 


SI 


SI 


SI 


70 


50 


35 


PIPS 


^73 


375 


424 


70 


50 


40 


POCL-1 


nsn 


376 


356 


62 


50 


32 


POCL-2 




376 


356 


62 


50 


32 


Verbal Flaency 




375 


424 


71 


50 


39 


CRS^l 




376 


326 


7b 


50 


5l 


CRS-2 


m 


375 


356 


68 


50 


SI 


eRS-3 


USB 


375 


359 


71 


50: 


SI 


ZRS-U 


452 


376 




70 


50 




PI AT- Math 


471 


376 


424 


68 


50 


47 


P lAT-Reading 


456 


376 


398 


eh 


50 


42 


Child lriterview-1 


478 


376 




70 


50 




Child rnterview-2 


460 


376 




- 68 


50 





Notes: Analyses fbrquestion 3 use all aval lable subjects with spring 1979 data 
(^nd values for entry-level covarlates); for question ^, all available 
subjects with complete dataacross all instruments In spring 1979; and 
for question 5, all available subjects with complete data across all 
occasions for each instrumfnt. The entry "SI" means_that the sample of 
children with data for that measure Is insufficient for analysis for a 
particular question. For single-occasion measures, question 3 and question 
5 analyses are identical. : 
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Question 3 ' Consideving outcome varieties one at a tirne-^ are 
PDC (md compoj^ison children differ^^ the end 

of first grade _ (spririg 1979)? In particular^ are _ 
there group main effects or group-by^site interactions? 

Method of analysis ; This question was addressed by anivariate two- 
way analyses of covariance. The dependent variables were each spring 1979 
child dutcome variable taken separately; the independent variables were 
group, site^ and the grdup-by-s i te interaction term. Covariates were 
different for the samples initially tested In English and Spanish as 
previously indicated. 

FJ-ndJngs for children initially ^sted in English . Table 2k summarizes 
the results of analyses for the subsample initially tested In EngHsh. 
A significant group main effect was found for PjAT-Reading; significant 
group-by-site interactldhs^ fcr both PIAT-Reading and Verbal Fluency; 
Post hoc comparisons of PIAT-Readihg adjusted inean scores for PDC and 
compar I son groups within sites are presented in Table 25- These tests 
clearly indicate that the group-by-sl te interaction is the result of 
a simple effect of group within site-^I.e.', group membership is associated 
with a mean difference in PIAT-Reading scores favoring the comparisdh 
group at drily one site, Michigan. Also evident from this table Is the 
fact that Gedrgia, the qnly PDC site without a local comparison group, 
has the lowest meari PIAT-ReadIng scores of any site; Siven the cbhs|stentiy 
strong site effect acrdss all measures shown in Table 2A, it is reasonable 
to assume that If there were a group df cdmparisdri chi Idren at the Georgia 
site, they would also have low mean scdres dri the PiAT-Reading. The 
inclusion of the Georgia PDC group without a cdmparisdri group serves to 
lower the PDC mean but not the comparison meari. As the bdttdrn row of 
'Table 25 shows, when the Georgfa site is excKuded from the analysis df 
PIAT-Readirig, the overall difference in group means disappears. _!h_sum, 
there is hd basis for concludlrig that the overa[l performances of PDC and 
comparison grdups initial ly tested in Eng!:sh are different oh the PIAT- 
Reading subtest. Regardlrig the rather large difference in PlAT-Readjng 

performance associated with group membership at the Michigan site, J t Is 

not clear that the effect should be attributed td differences In educational 
program; 

Table 26 presents the results of pog^ hoc^ comparisons of PDC and 
comparlsongrdup mean adjusted Verbal Fl uency scores within each site: 
The significant group~by-s i te Iriteractlori for Verbal Fluency appears 
due to significant d I fferences between Qrdups_§oI rig iri opposite directions 
at two sites. In Maryland, children In the PDC grdup scdred higher on 
Verbal Fluency than chiloren in the comparison group; iri Washington, 
comparison children scored higher than PDC children. 

Rindlnqs for childreri Iri? t lal ly ^ sted In Sp ahi^. Table 2? sur^^marizes 
the results of univariate analyses of spring 1979 outcome varlables^for ; 
the PDC and comparison sarrples initi^any tested in Spanish. S i^gn i f i cant _ 
differences associated with group membership appear for two variables— the_ 
CRS-4 "Academic Motivation" scale (?DC>Comp) and the PIAT-Reading (eomp>PDCj . 
No sigriif leant group-by-site interactions were fdurid. 
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Table 24 



Results of Univariate Analyses of Cbvariahce dh Spring 1S79 
Child Outcome Measures: Sample Tested in English (maximam n=^8]) 



» - — — 
I 

— — uu L uunic — nco b u re 


Ml 


EFFECTS 


— Cossr-iMes 


Group SJts — 


- trou?-by-S i te 








Don cngiisn 




.0001 


.0001 




r 1 r o 


H / y 


.0273 


.0407 




pnr^ - 1 

r uu L 1 




.0021 


.0013 


• 


PHPI -9 
r u L JL 




.0001 


.0255 




Verbal Fluency 




.0019 


.0001 


.0017 


CRS-1 


ms 


.0003 


.0081 




eRS-2 




.0036 


".0013 




CRS-3 


k56 




;0024 




CRS-4 


452 


.0007 


.0126 




PiAT-Math 


471 


.0001 


.0475 




PIAT-Reading 


456 


.0001 


.0328 .0059 


. 0482 


Child Interview 1 


478 








Chi Id Interview 2 


460 

1 


.0001 


.0016 





Note: Table entries are statistical s i gn i f 1 cance 1 evel 5 , if lower than 
.05. Covariates for these analyses are: entry^level WPPS I and 
POCL-2, and dummy variables for sex, prior preschool • experience 
arid ethrii'jity. 
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Table 25 



Adjusteci Means for PDC arid Comparison Groups at Each Site; 
Spring 1979 PIAT-Reading Ihstrumeht (h^^56) ; Sample Tested in English 







QROiiP 






Site 


_ N _ 


PDG 


Gomparlsbn 
N Mean 


Contrast 


Cal i forn ia 


17 




17 


20.63 


NS 


Co lor a do 


20 


oh oil 




2^ S8 


NS 


Connecticut 


23 


22.48 


34 


22.76 


NS 


Florida 




21;53 


25 


24.46 




Georgia 


27 


20.27 






ft 


Iowa 


13 




13 


25.52 


NS 


Maryland 


27 


25.15 


22 


23.51 


NS 


Michigan 


20 


- - 

20;66 


29 


26.32 


p<;00Ol 


Texas 


12 


22.96 


13 


22-36 


NS 


Utah 


22 


23.74 


32 


23.32 


NS 


Washington 


2if 


22.29 


26 


22.24 


NS . 


All Sites 


233 


22.49 


223 


23.52 


p=.0328 


Al 1 Sites but Georgia 


206 


22.78 


223 


23.52 


NG 













Notes: Means are residuals cf regression on observed data, aslno as 
independent variables entry-level WPPSi and POCLrS scores and 
dummy variables for sex- ethnicity and prior preschool experience 

Residuals are restored to overall mean levels. Significance 

levels for contrasts between treatment-group means are presented 
if .05 or less. 



table 26 

Adjusted Means for PDC and Comparison Groups at Each Site: 
Spring 1979 MSCA-Verbal Fl uehcy instrument (n=480) ; Sample Tested Iri Engl ish 





GROUP 




Si te 


N 


PDC 

flean 


Cbmi: 
N 


>arisbn 
Mean 


Cont rast 


California 


17 


16.02 


18 


16.76 


NS 


Colorado 


20 


1 ] .27 


14 


13.98 


NS 


Connecticut 


27 


20.47 


J6 


15.08 


NS 


Florida 


31 


13-68 


26 


13.79 


NS 


Georg ia 


9 1 








— 


Iowa 


15 


16.84 


13 


16.62 


NS 


Mary 1 and 


27 


22.75 


22 


17.67 


p=.0103 


Michigan 


21 


15.82 


- 32 


16.39 


NS 


Texas 


12 


17.39 


14 


16.14 


NS 


Utah 


23 


17.02 


34 


; 15.52 


MS 


Washington 


25 


15.58 


26 


19.34 


P=.0329 


All Sites 


245 


16.40 


235 


16.72 


NS 



Notes: Means are residuals of regression on_obseryed_data , using as 
independent variables entry-level WPPSI and POCL-2 scores arid 
dummy variables for sex, prior preschool experience and ethnicity 
Residuals are restored to overall mean leve|s^ Significance 
levels for contrasts between treatment group means are presented 
only if .05 or less. 
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Table 27 

Results of Univariate Anaiyses of Covariance on Spring 1979 

Child Outcdme Measures: Sample Tested in Spanish (rnaxirnUrn n=70) 



O u tcome Me as ure 



EFFECTS 



Covgri a^t es Grou p Site 6ro a p-by-Si te 



BSM-Eh§l ish 
BSM-Span i sh 
PiPS 
POCL-1 
POCL-2 

Verbal Fluency 

CRS-l 

CRS-2 

CRS-3 

CRS-4 

PIAT-Math 

PIAT-Reading 

Chi 1 d Interview 1 

Chi Id Interview 2 



70 
70 

70 
62 
62 
70 
70 
68 
70 
70 
68 
64 
70 
70 



,0001 



.0362 
,0131 .0001 



,0033 .0051 



Note: Table entries are statistical significance levels, if lower than 
.05. Covariates for these analyses are dummy variables for sex 
and prior preschool experience. 



Table 28 further explores the significant group main effects through 
post hoc wi thlh-s! te comparisons. For the Academic Mot ivat ion seal e , PbC 
children were_ rated higher than cdmpar i son chi 1 dren onl y at the Texas site. 
By: contrast, PIAT-Readihg scores are sigrlificahtly higher for comparison 
children at the Texas site. Although the direction and. magn i tude of 
difference in PlAT-Readlng performance was similar at the Califbrhla site, 
the sample sizes there were too small for the difference to reach statistical 
significance. Including data for six eonnect[cut PDG children (none of 
them in the comparison group) in analyses of the Pj^'^^'^^^di ng scores 
Increased, the magnitude of the group effect, much as the Inclus[on of data 
from the_ Georgia si te_affected the analysis of PIAT-Reading scores for 
the sample tested Iri_English,_ However, in this instance, excluding the 
Connecticut sample did not eliminate the overall group difference. 

hn^^t ir>D k : CoKsidering all outcome va2^arles_ _szrrpultanecusl-y-^ 

-avc PDC and cornparison children different .at th^^ end 

of first grade (spring 1979)? In particul::T:, is 

there a group main effect or a group-by-site intevaction? 

Method of analys is . _ The overall groUp profiles of spring 1979 outcome 
variables were compared In a twp-waymUl t iyariate analysis of covariance. 
The dependent variables were all spring 1979 butcbmes cons i dered simul- 
taneously; independent variables were group, site, arid _ the group-by-sj te 
interaction term. Covariates differed for children Initially tested In 
English and in Spanish as previously indicated. 

Relationship to analyses f^-^ est I on 3 * The analyses performed in 
respbni.e to this question might be expected to produce somewhat different 
answers than those obtained to question 3 for two reasons. First, It is 
possible to find differences In overall bUtcome profiles in the presence 
of scattered and mixed univariate differences br even in the absence of 
any significant univariate differences. Second, the sample_fbr the multi- 
variate analyses reported In this sectjon was smaller than for the univariate 
analyses in response to question 3, since some chl|dren in the spring 1979 
sample were not tested or rated on some measures and only children with 
complete data were included in the mul tivariate analysis. Thus, multi- 
variate analysis Is not equivalent to the sum of univariate analyses but 
supplements them. !f both approaches, prbduce similar findings, these 
findings have greater credence. If the results contradict one another, 
an effort must be made to resolve the difference. 

Findings for the sample t n i 1 1 a 1 1^ tested in English . Table 29 presents 
the results of a multivariate analysis of covarUnce of spring 1979 outcome 
measures fbr the PDC and comparison samples initially tested in English. 
The total sample available was 376--78% of the ^80 chi Idren In th i s subsampl e 
measured on at least one butcpme variable in spring 1979. The top section 
of the table reveals a significant difference In the outcome prof i les of 

children In the PDG and comparison groups as_well as a significant group- 

by-site interaction. The bottom section of Table_29 indicates which variables 
made significant contributions to the overall difference in group profiles. 
The pattern of these results largely replicates findings bf the univariate 
analyses fbr question 3, in spite of a reduction in sample size_(ari^__ 
therefore, a difference in sample composition). Specific profile differences 
arid their directibns are summarized below: 



Table 28 



Adjusted Means for PDC and Comparison Groups at 
each Site for Spring 1979 (Grade 1) PIAT-Reading 
and CRS-4 "Academic Motivation" Scale, 
Sample Tested Over Time in Spanish 



VariaBle 


Site 


Group 


Cont rast 


PDC 


Comparison 


ri Mean 


n Mean 


tRS-k 


Eal ifornia 
Connect i cut 
Texas 


4 5.52 
8 11.61 
25 10.80 


7 5.72 
1 11.80 
25 9.49 


NS 
NS 
P=.0513 


All Sites 


"37 10.40 


33 8.76 


p=.0131 


P lAT-Readlng 


Cal ifornia 

Connecticut 

Texas 


4 16.89 
6 15.39 
24 21.54 


7 21.50 
23 24.08 


NS 
p=.0402 


All Sites 

Sites, 

Connecticut 

Removed 


34 19.91 
28 20.88 


30 23.48 
30 23.48 


p=.0033 
p=.0248 



Notes: Means are residuals of regression on observed aata, us[ng as 

independent variables dummy variables for sex and prior preschool 
experience. Residuals are restored to overall mean levels. 
Significance levels for contrasts betWeeh program group means are 
presented only if .05 or less. 

\ 



X 



Table 29 



Results of Multivariate Analysis of Covarlance of Spring 
(Grade 1) Child Outcome Measures: Sample Tested In English 







Outcome Measure 


Covariates 


Erotip Site 


Group-by-S i te 


OvmaZi CompwvUon 


.0001 


.0009 .0001 


.0056 




Contkibation6 Each 
















BSH-Engl ish 


.0001 


.0289 .0001 





PIPS 


-- 







POCL-1 


— 


-- .0016 


^- 


POCL-2 


■ .0014 


.0227 




Verbal Fluency 


.0018 


.0001 


.001 1 


CRS-I 


.0005 


.0197 




CRS-2 


' -0031 


-- .0010 




CRS-3 




.0389 .0010 




CRS-4 


.0001 


.0280 .0259 




PIAT-Math 


.0001 






n > rv — I : - - — 

( t r\ I l\wu 1 1 < V;^ 


'^ ^ 1 




nhii 


Child Interview 1 








Chi Id Interview 2 


.0013 


.03^2 





Notes: Table entries are statistical significance Revels, If lower than 
.05. Covariates for these analyses are dummy variables for sex, 
ethnicity end prior preschool experience, and entry-level values 
for WPPSI and POCL-2. 



1979 
(n=376) 
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• PiAT-Readi ng . Differences irv mean PIAT-Readlh§ scores favored 
the comparison group. This difference is again interpreted 

as primarny the result of a large difference favoring the 
comparison group at the Michigan site and the absence of a 
ccmparison group in Georgia, a low scoring site. The difference 
between groups amounted to .19 standard deviation units, 

• Verbal Fluency , A s i §n i f icaht grdup-by-s f te interaction was 
found. As in the preceding univariate ahr-jlyses, site-level 
comparisons point to significant differences in opposite 
directions at the Maryland and Washington si tes , with no 
other site- level differences between groups. 

• BSM-Ehgl ish . An overall difference favoring the comparison 
group was found: PDC=12.60; compari son=12.§d. The 
difference ambuhted to only .13 standard deviations; 

m £RS--^ ^'Dependence ." There was an overall di fference favoring 
comparison group children: PDC=5.67; comparisbn=5.^7- (Higher 
scores indicate greater "dependence.") The magnitude of this 
difference was .11 standard deviations. 

i CRS-^^ "Academic_Mdtivation ." The overall difference favored 
PDC children:. _PDC=10. 00; comparison=9.^0. This difference 
amounted to .19 standard deviations. 

Although the outcome profiles for PDC and comparison groups overall 
are reliably different, the implication of this difference Is not clear 
(even if we leave aside the question of whether the difference can be _^ 
attributed to the educational program rather than to other factors) . First 
nei ther_grbup's profile is consistently higher than the other^_second , 
what differences there are tend to be confined to part Icular measures at 
particular sites. Finally, thegrpup differences are small (on the order 
% of two-tenths of a standard deviation in magnitude), suggesting that the 
multivariate analytic procedures may be moresehsi tive than is justified 
by the meaning of the educational impacts which_have been identified, given 
our overall large sample size and the strong influence of site characterist 

Findings for children i-ntt ially te s ted i n S panish . The same ana lysi s 
was carried out for children initial ly tester in Spanish^ The aval lable 
sample size was 50--71? of the 70 children in this subsampie measured on 
at least one outcome variablejh spring 1979. Children were distributed 
very unevenly across sites. There were only seven chi 1 dren represent i ng 
the California site, and only two of these _ belonged to the PDC group. 
There were only five children from Connect icut ,al 1 in the PDC group. 
The remaining 38 children were from Texas. Given gross imbalances in sampl 
sizes across sites and groups and the excessive number of dependent ^ 
variables for the number of children in the total sample, the analytic 
results were judged too unstable to report. 
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Qoestion 5 : Considering all occasions of measuTement of each 
child outcome vaviable from fall 1976 through 
spring 2979-^ are there trends and patterns^ over 
time in group differences or group -vy^ site 
interactions? 

Method of analysis . The repeated me'=?sures analysis for each Instrument 
was accomplished by a multivariate two-way analysis of covariance. Ten 
of the 13 instruments considered In this section were administered oh more 
than one occasion; three — CRS-4, CI-1, and CI-2 — were first adini ni stered' 
in spring 1979 and have not been included in t he _ rejDea ted measures analyses. 
The independent variables were group and site. Covariates remained the 
same as for previous analyses. For reasons analogous to those articulated 
in the previous section, analyses of data for children initially tested 
in Spanish were not conducted. 

Findings for children initially tested in English . Table 30 summarizes 
the results of analyses for each butcbrrie measure. Significant differences 
bver_ time associated wi th group membership were identified for two variables: 
the POCL-2 "Sociability" scale and the CRS-2 "Aggressiveness" scale. 
Group-by-site interactions over time emerged for four measures: Verbal 
Fluency, ERS-2 "Aggressiveness" scale, GRS-3 "Dependence" scale, and 
P I AT-Read I ng . The nature of each of these 1 ong I tud i na 1 effects Is considered 
be 1 ow : 

• POCL-2 main effect . When group mean total POCL-2 scbres — the sum 
of values across fbur bccas ibn5--were cbmpared^cbm^^ children 
were found to score s i gh I f I cant 1 y higher than PDC children. This ^ 
difference Indicates that comparison children as a group we ce^judged 
over time to be slightly more "sociable" than PDC childrerT!, The 
magnitude of the dlffef^ehce was approximately one-quarter of a 
standard deviation, ^differences between groups did not appear 
for any single occasion; neither was there any indication of 
differences in trends or patterns over time. Visual inspection 
of POCL-2 curves In Figure 17c shbws that the largest difference 
between the two groups occurred during the fall of their Head 
Start years befbre children had spent any sighif leant amount of 
time in the PDC program. 

m CRS.-2 maljL effect- and- i nteract loa . CRS-2 "Aggressiveness" scale 
ratings were made on three occasions beginning In the spring of 
1976. Lower values on this scale represent judgments that children 
are less aggressive. Tests.fbr linear trends over time were 
sighificaht. Aggressiveness ratings decl _i ried fbr bbth PDC and 
comparison groups over time^ but they decHned at a faster rate 
fbr the comparison group. The presence of a linear trend Is 
also suggested by CRS-2 curves in Figure 17d. This Interpretation 
of the group effect, however, should be made cautiously given the 
significant group-by-site interaction also found. 



Table 36 



Results of Haltlvariate Analyses of Covariance with 
bhi Id Outcome Measures from Fall I976 through Spring 
1979 as Repeated Measures: Sample Tested In English 
at Entry (Maximum h = 480)^ 



Number of 
Occas ions 


Instrument 


N 


Group 
Main Effect 
Over Time 


6roup-by~ 

Si ts 1 n tprpir't" T nn 

Over Time 


Variables 
. Measured 
ph four 
Occas ions 


BSM-Engl ish 


431 







PIPS 








POCL-1 


356 






POCL-2 


356 


P<.05 




Verbal Fl uency 






P<.b5 


Variables 


CRS-1 


326 






Measured 
bh three 
Occas ions 


eRS-2 


356 


P<-05 


P<.05 


CRS-3 


359 




P<.05 


Variables 
Measured 
on two 
Occasions 

1 


PIAT-Math 


kzk 






PIAT-Reading 


398 




P<.05 



Only effects reaching significance at p<.05 are indicated. 
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Taming to the interact! on ,wi thin-s i te comparisons of linear 
trends indicated that significant group differences occurred 
only at. the Michigan site where ratings of aggressiveness 
declined much morie rapidly for the comparison group than for 
the PDC group from Head Start through first grade. 

♦ Verbal Fluency Interaction . This finding basically replicates 

the findings for questions 3 and ^, Indicating that the differences 
observed in spring 1979 have existed over time. At the Maryland 
site, PDC children have consistently over time scored higher than 
cbmparisbn chlldreh. When scores were summed over all four 
occasions of measurement, the difference between group means 
amounted to .85 of a standard deviation. At the Washington site, 
the opposite trend was found: comparison children have consis- 
tently scored higher than children. In the PDC group. Tfiere the 
difference between group mean total scores was ,5 of a standard 
deviation. The presence of mean differences In Verbal fltiency_ 
at the Maryland arid Washington sites since fall of the Head Start 
year suggests _that these group d i fferences may well result from 
pretreatment factors rather than later educational experience. 

♦ MS--3 Interaction . CRS-3 "Dependency" scale rat ings_ were made bri 
t:iree occasions beginning ih spring 1975. Higher values on this 
scale represent higher levels of dependency. Post hoc analyses 
indicated that the overall interaction effect resulted from linear 
trends differentiating PDC and comparison groups at two sites-- 

Cbnhecticut and Florida. Specifically, at both of these sjtes 

ratings bf dependency decl ined stead 1 1 y and markedly for children 

in the cbmparisbn grbup, but little or hot at all for the PDC group. 

♦ P_IAT-Read Ing Interact ion . The PIAT-Reading subtest was_admihistered 
twice — at spring kindergarten and spring first grade. The grbup- 
by-site interaction was found to have two dimensions, first, 

group mean total scores--sammed across two occasions — differed 
significantly at two- sites: Michigan and Florida. both sites, 
comparisbh children butscored PDC children on average across two 
occasibns. Second , rates bf gain frbrri spring kindergarten to 
spring first grade d i f f ered _ s _i gh i f I can t [y for PDC and comparison 
groups at three sites. In Colorado, POC children gained more 
from kindergarten to first grade than comparison children; ih 
California and Michigan, comparison children gained more. 



Other Child Impac^^na-ly^ses^ 



In the precedlhg section, di fferences between PDC and comparison 
grbups on ch 1 1 d butcbrhe means fbr grade 1 were explbred. Thbse analyses 
of d i fferences _ In central tendency are complemented ih this section by 
analyses of differences between grbups on summary score d i s t r i but i bhs , 
as well as by Item-level analyses. 
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ai^trj4wt^i43r^a4- analyses of s u mmary scores . The d i stri but ions of 
summary scores for each treatment group were compared for each child 
outcome, measure . The results of these comparlsdris are summarized, in 
Table 31; Figures Bl_ to Bl5 of Appendix B portray score distributions 
by treatment group for each measure. 



Distributions of suirmfiary scores for the two treatment groups are 
compared fay dividing the distribution for the fall study sample available 
for each outcome measure into units of equal size on the measure, In such 
a way that there are about ten divisions spanning the full range of the 
measure. For instance^ the distributLori of scores for the grade 1 PIAT- 
Reading was divided_into nine bands of size five points spanning the range 
between 2.5 and 47«5 points; the actual obtained score distribution ranged 
between five and 45 points. Gnce the distributions are divided in this 
fashion, the numbers of cases for each treatment group in each band are 
compared by means of a test. If the distributions show significant 
overall differences, the bands at which such differences occur are iden- 
tified through the use of Goodman's intervals test (Goodman, I965). 

.Differences in surhmary scored istr I but ions between groups were found 
for five of; fourteen grade one. child outcome measures: BSM^English^ 
PIAT-Reading, PDeL-2 "Sociability," GRS-1 "SeU-Assurance ," and CRS-2 
"Aggressiveness." Differences between distributions for all measures are 
associated with changes in the location of central^ P^^f^^ 9^_^15^^ ' ^9" 
modes, rather than changes in range. Thus, differences in distributions 
for the BSM-English, PIAT-Reading and POCL measures are associated wl th 
central peaks at si ightly_iligher score levels for comparison than for PDC 
children. For the two CRS measures^ peaks occur at si ightly higher levels 
for PDC than for cbmparisongroupsj, although it must hot ■ be_ forgbtten 
that for the CRS-2 "Aggressiveness" scale higher scores indicate higher 
levels of ''aggressive" behavior. Distributional differences are relatively 
miner, even though statistical tests show such differences to be sighificanc. 



Ana^lyses^ 44:^ m- level responses . Item-level comparisons of response 
frequencies for PDC and comparison children were conducted for all child 
butcgme_measures. Differences were found for items from eight measures — the 
two PIAT subtests^ the BSM-Engl I sh and BSM-Spanish^ MSCA Verbal Fl uency, 
CRS-1 "Sel f-Assurance^" CRS-3 "Dependency," CRS-5 "Academic Mbt I vat I ph." 
Response category differences, not precisely cbmparatHe- tb item-level 
differences, were found for the Pi PS, 



Analyses of PIAT item-response frequencies take into account the 
fact that ho children were administered all 84 items of either subtest, 
since this ihdiyldually adrhi his tered measure has defined test-start and 
test-end criteria.. Ih the PIAT-Math^ 35 items were attempted by at least 
ten percent of all children respbndihg; bf these, five showed differences 

by group in the percentages of children giving coxTect responses (see 

Table 32). Four of these differences favored the comparison group, while, 
one favored PDC. The items included a word prbblem (no. 18) ,. knowledge of 
the days in the week (no. 19), the ability to tell time (no. 21), a divlslbri 
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TlbVe 31 



Comparison of Surrrmar/ 
Score Distributions by Treatment Group 
for Spring 1979 (Grade J) ehild 0atCG;^e 
Measures 



Mo a c n r*o 


PNesult 
of 

Significance Tests 


Score Ranges at 
Which Significant 
Differences Occar^ 


uv ci a 1 • 

— ^ 1 1 I C 1 CI C 


BSM-Engl ish 


X2 = 


20.0, 9 d.f. ; P = 


.019 


-2.3 


to 


-5.7: 




C psaks 










-1.7 


to 


-1.0: 


P>C 


h 1 a h r 










-1.0 


to 


-0.3: 


OP 


than P 


PI AT- Read i ng 


X2 ^ 


16.7, 8 d.f . ; P - 


033 


-o.g 


to 


= 0. 1 : 


P>C 


C peaks 


















higher 


















chan P 


POeL-2 "Sociabi 1 ity" 


X2 = 


15. 1 , 6 d.f . ; P = . 


020 


-0:3 


tc 


+ 1.0: 


OP 


C peaks 


















higher 


















than P 


CRS-1 "Self-Assurance" 


X2 = 


16,0, 9 d.f . ; P = . 


068 


-0.9 


to 


-0.2: 


C>P 


P_ peaks 




[Max. 


1 ikel ihobd test , 






to 


+ 1.1: 


P>C 


higher 




P = . 






+2.U 


to 


2.5 


P>C 


than C 


eRS-2 "Aggressiveness" 


X2 = 


16. i*, 8 d.f . ; P = . 


038 


+ 1 .2 


to 


+ 1.8: 


p>e 


P peaks 


















higher 


i 
















than t 



Note: Only measures for Which distributions differ are included in this table. 

In standard deviation units from the overall mean; P = PDC, C ^ Cdmparisdh. 

^Distributions are illustrated in Figures B1-B14 of Appendix B: 



Table 32 

Item Response Frequencies by Group 



. PIAT-Mafhematics 










1 


Item 
Number 


^rief Description 


_ Total. 

Finn Hi nri 


% Correct: 
PDC Comp 


£ (Fisher's 
Fxsrt Tp^t^ 
















18 


How many pennies 
nickel and penny? 


in a dime. 


492 


47 


55 


.043 


19 


How many dayr in 


a week? 


466 


32 


40 


.040 


21 


Which clock shows 


8? 


386 


55 


70 


• .002 


29 


How many nickels 


= 40?? 


193 


30 


18 


.050 




Six boys had 5 pennies 
et'ch. How many pennies 
al together? 


72 


27 


51 


.009 


PIA'l-Read'^ng 


















% Correct: 






iJamber 


Word Read 


Total 


PDC 


Comp 


p 


20 


Play 


434 


72 


79 




.042 


21 


Jump 


446 




86 




.002 


22 


Ki tteri 


432 


42 


60 




;eeoi 


23 


Wagon 


403 


27 


45 




.0001 


2k 


Fi sh irig 


402 


32 


5^ 




.002 


25 


Brook 


4o4 


23 


32 




.039 


32 


Flour 


112 


27 


46 




;040 



problem (no. 29) and a mu 1 "t i pi I cat ion problem (nb; 3^) ^ For the last two 
Items; response levels were low and the effects of guessing could well be 
strong; the items certainly seem well above usual grade one performance 
levels. PDC cnildren surpassed comparison children in the proportion of 
correct responsies on item riumbier 29. 

Jri the P I AT-Read i ng , ' 28 items were attempted by at least ten percent 
of a' 1 children responding. Of these, seven showed d i fferences by group 
in the percentage of children responding correctly (see also Table 32). _ 
Ail differences In Items favored the comparison group. The Items all deal f. 
with reading words, and start with the second such item of the test: 
"play" (no. 20), "jump" (no. 21), "kitten" (no. 22), "wagon" (no. 23), 
"fishing" (no. 24), "brook" (no. 25) and "f^bur" (no. 32). 

Overall analyses identified two sites contributing to cen t ra 1 - tendency 
differences between groups that could help explain these item-level differences 
One site had relatively low va'ues and no comparison group; and the other 
accounted for a significant site-by-treatment interaction (see Table 25 
in the previous section). Itein-level analyses for items showing significant 
differences were repeated, leaving these two sites out. Although differences 
between groups d i mi h I shed arid In fact became hohslgrii f icant for two items, 
sign I f lean t d i fferences still remained for Items 21 , 22, 23 , 2^ arid 32. 

Eighteen responses were evaluated In the BSM, and for the English 
ve slon, there were between-group differences on six Items. For all six, 
C'ymparison group children showed higher percentages of responses rated 
jS correct than did PDC children; differences in the percentages ranged 
from five to eight percent. The test items showing differences are listed 
In Table 33- Children rifspondirig to the BSM-Spanish displayed between-group 
differences on two of the eighteeri ques t Ipris ; for both, PDC childrisri had 
higher frequencies of correct responses thari d id' cbmparlsbri children. 

In the FiSCA Verbal Fluency measure, the task is to name as many objects 
of a given type as possible in a fixed span of time. For .each of four 
noon types (names of persons; animals; things to eat and toys); oar analyses 
compared the distribution of children In each group by the number of objects 
named. The distributions were different for names of persons; more PDC 
than cbmparlsbri group childreri riamed none or only one person. 

Of eleven i tems cbmpbs i ng the CRS-^1 "Sel f-Assurance" jscale , two 
showed sighificaht differences between groups. The item COOPERATES AND 
SHARES WITH OTHERS showed PDC children higher In rated frequency than 
comparison group children. The Item ATTEMPTS TO SOLVE SOCIAt PROBLEMS 
WITH LITTLE ADULT ASSISTANCE showed a difference in response distribution; 
with PDC children having a relatively flat distribution, while ratings 
fbr cbmparlsbri childreri peak at ceritral values. 



Of the two items forming the. CRS-3 /'Dependency" scale, IS CONTROLLED 
OR iNFLUENCED BY OTHERS showed PDC children to be displaying this behavlbr 
more frequently than comparison group children. 



no 



Table 33 

Item Response Distributions by Sroap, BSM-English arid BSM-Spariish 



Bm-Enql 












Item 
Number 


Question 


Total 
Respondii.g 


% Correct: 
PDC Comp 


P (Fisher's 
Exact Test) 


6 


(Point to bOth_houses:) 
What are these? 


545 


79 


87 


.007 


8 . 


(Point to doors of both 

houses at onee:) 

And (what are) these? 


546 


OO 




.014 


15 


, (Point to eyes of both' 
red fish:) 

Arid why do you think their 
eyes are open? 


546 


66 


72 


.049 


16 


Are the fish wet? Why? 


545 


67 


74 


.048 


19a 


(Point to girl :) 
What is the girl doing? 
Uo you thinK sne s 
happy? Why? 


546 


94 


97 


.045 


22 


(Point to plate:) 
What happened to the 
king's food? 


544 


74 


. 81 


.022 


BSM-Span 












16 


If he had not taken off 
his shoes (pause), what 
would have happened to 
them? 


92 


24 


9 


.044 


24 


What would have happened 
if the dog* had riot eaten 
the food? 


91 


38 


15 


.014 



6f three items composing the eRS-4 "Academic Motivation" scale, 
the Item COMPLETES ASSIGNMENTS showed PDC chi Idren displaying this behavior 
relatively more frequently than comparison group children.; 

_ Finally, the PIPS measure could be analyzed. Into twenty-five task- 
relevant response categories, each denoting an alternative strategy fbr 
sblvinq an Interpersonal problem. Nineteen of these categories were 
mentioned at- least once by ten percent or rrore of the chrldren responding.' 
Of these nineteen, one showed differences in the number of children in 
each treatment group that mentioned the category at all (AUTHORITY, 
REFERENCES, e.g. ^ "I'll tel] my mother and she'll come and take it from 
you."; more PDC than comparisbh chi Idren mentioned this strategyat least 
once). In two other categories, the numbers of children mentioning the 
category did not differ between groups, but the number of times the strategy 
was mentioned was higher for comparison than PDC children for both categories 
(ASK FOR IT, e.g., "Can 1 have it?", and TRADE A TOY FOR IT, e.g., "I Ml 
give you this car if you give me the — - " ) . 

Sumnlary of item-analysis findings . Only the findings for the PIAT- 
Readihg appear to be consistent with other analyses conducted^ arid to 
convey a clear interpretation. Differences in response frequencies for 
some PIAT-Reading items favored the comparison over PDC group. These 
differences appeared only for some of the items that require children to 
correctly pronounce written words of increasing phonologic complexity 
and decreasing familiarity. The difference Identified is small but appears 
reliable even after some site-level variation is removed. 

The ihterpretatiori of item-level differences for the two BSM measures 
is less clear. Di fferehcesih. response frequencies are small >_and the 
Items do not appear particularly difficult for the overall child population. 
Extensive interpretation of these differences is not justified for three 
measures: covari?"e adjustments for entry-level score differences tend 
to remove differences in grade one BSM outcomes, the set of items is not 
particularly coherent, and differences are small. 

For the remainder of the instruments, also, extensive interpretation 
of differences in item response frequencies appears inappropriate. In 
the PIAT-Math, only three of the five items for which differences appear 
are well within the typical performance range for this ability level, and 
these Items show little coherence in content. Differences found for the 
CRS scales are composed of four items, of which two favor PDC; one appears 
to favor the comparison group and one is difficult to interpret. Finally, 
response category findings on the PIPS do not. support straightforward 
I nterpretat ions . 



Overview of Impact Findings 



The various findings discussed In this section oh the impact of PDC 
on grade one child outcomes, have been consolidated. Table 3^ summarizes 
the child outcome findings across the several approaches used to assess 
differences In central tendency, distributions and i tem-1 eveT responses 
for eacTi measure. The findings appear to be replicated with fair consis- 
tency. In summary, our assessment of the Impact of the PDC program on 
chlldreh'^s measures of butcdrne at the end of grade one Is that a small 
number of d I f ferences between PDC arid com^arisbri, groups overall can be 
Identified, but they are general ly of^sma^l 1 magriltude arid nbt sufficient 
to be educationally fneari i rigful . ^^he measures themselves show acceptable 
levels of variability between'^fii 1 dren for the task of establishing between 
group differences, although most of the variation in measures is explained 
by within-group attributes, the principal attribute being Sjte and site- 
related effects . Final ly, the al ter nat Ive analytic approaches used 
ideritlfied the same bverall ass^sin^t f Indlngs. The fact that small 
differences can be cbrisistently identified by various approaches prbv ! des 
some reassurance that, If there were ed^atlbnally meanirigful differences 
in ddmairis measured by bur Instruments, \^cbuld detect them. 

\ 

\ 

The Relation of -Otiier^tud y Mea su r^ to G ra d e 
One Child Outcomes, Independent of Treatment 

. ~~ ^ \~ 

Here we consider, in a preliminary way, the relat^rx^n between variables 
In parent and teacher domains of measurement Iri the PDC ^^aluatibri study 
and variables !n the child outcome domain. Measurements rn spring 1979 
offer the first opportunity In this study to consider the as^ciatlons ^ ^ 
between variables In different domains, since this is the f ' oceans 4i5n 
iri which data Iri the parerit arid teacher domains have been coj^^j^e^^ted . 

The aria lyses and f iridlrigs_preserited_here must be viewed as preliminary 
because formal sped fi cat ibri bf a mbdel fbr relations between varibus^ 
PDC domains Is still iri ari early stage of development. We s imply _db nt;^t 
know, for Instance, whether 1 1 is reasonabl^e to expect that slgniflcant\ 
changes In teacher behavior can be associated with significant changes 
in child outcomes measured in the same year ; effects might wel 1 be lagged . 
Further, the ways In which associations between teacher; and classroom, 
variables arid child butcbme variables can be explored need further thought. 
Since PDC follows the development arid school experiences of a sample of 
chi Idren, classrooms arid teachers are riot represented in a balanced way 
in the child sample. Thus, fbr some classrbbms there may be eight children 
in the sample, while for others there is brily one. For ribrie of the class- 
rooms in the study are all of the childrea in the classrobm represerited, 
or even half of the children. 
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^ Table 3^ 

_ '\ 

Summary &f Findings Contrast ing'-^pDe and eompar[son Groups on Spring 
Grade 1 (1979) Child Outcome Measures^.bs ing Different Analytic Procedures 





Analysis of Adjusted Da t a :^ 


_ _x 

unau J US tea 

Analysis' <?f 

Variance 




Item 
Ahaly&r^s 


Analysis of 
Cbvariahce, 
Each Measure 


Mul t ivar iate 
Analysis of 
Coyariarice^ 
al 1 Measures 


n 1 <r t* r 1 Km — 
U 1 5 L r 1 DU 

t ional 
Tests 


BSM-English 




P<C 
(.13s.d.) 


_P<C 


C peaks 
slightly 

1 1 1 1 1 C 1 >^ 


6 of lb items differ 
al 1 differences P<C 
on % cor rec t 


BSM-Spanish 











2 of 18 items differ 
'"''^Indifferences P>C 
onv^ correct. 


PI AT- Reading 


P<C 
(. 19s. d.) 


P<C 
(.I9s.d.) 


P<C 

V . j^o .U.I 


C peaks 
si ightly 

h i nhp r 


J of^^b items differ 
all differences P<C 
r>n % correct- 


PIAT- 

Mat hematics 










5 of 35 items differ 
k difference$-P<C 
one P^C on % ctHrrect 


MSCA- 

J/erbal Fluency 










More P than C chHd- 
reri gave zero or p.h<^ 
person names . 


PIPS 






■ 






POCL-1 : 
"Task 
Orientation" 












POeL-2: 
"Sociabil ity" 








r n^i^t^^ 

slightly ; 
higher 




CRS-1: 
"Self- 
Assurance" 








P np^k^ 

s 1 ight ly 
higher 


4 of 11 items differ 
two favor _ PPC arid 
one is difficult to 
1 n terore t . 


CRS-2: 

"Aggress iveriess" 








P peaks 
slightly 

II 1 1^ 1 IC 1 




CRS-B: 
_!_LDependence' ' 




p>e 
(-ns.d.) 


(.18s.d.) 




1 of 2 items differ: 
PDC higher than C 
on rated frequency. 


CRS-4: 
"Academic 
Mot rvat Ion" — _ 




P>C 
(.19s.d.) 






1 _of 3 items differ: 
PDC higher than C 
on rated frequency. 


CI-1: 

"Attitude to-- 
ward Teacher" 












CI-2: 

"Interest iri 
Reading" 













Ibniy for sample tested in English at entry. Data adjusted for effect of 

0 ' • 



For these reasons, this section and the following one explore the 
relationships between variables iri diffe^reht domains In a highly tentative 
way- .The purpose of these two sections to document the fact that some 
associations between variables in different domains do exist. In order to 
suggest that further, more systematic explc^atic3n is warranted. Only a 
^?^_9f_?^? possible variables have been usedVin the analyses; analytic 
approaches are deliberately kept simple, in o^der to permit direct inter- 
pretation to the extent possible. \ 



After a brief discussion of the variables and analytic approaches 
used^ we outline and discuss associations found "between family character- 
istics and child outcomes. After that, issues in the analysis of relatiorts 
between teacher-domain and child outcome variablei are outlined, followed 
^y.^.?*^^^^^ of the associations found between teacher background variables 
and child outcomes, and then of associations between teacher outcomes and 
chi id outcomes . 



The Association Between Family Characteristics and Child Outcomes 

Variables and analyitljc metboud. Four variables defining family 
characteristics were examined for their relation to ch i Id. outcome variables: 
mother' s e du c a tion , family annual incom e , family structu re (as single-parent 
or two-parent families), and mot4ier's employment . Thirteen child outcome 
variables for spring 1979 (grade I) were Used. 

Variable associations were examined through the use of product-moment 
correlations and analysis-of-yariance approaches. Child outcome variables 
were not corrected for initial differences, so that the full analytic 
sample could be used in these preliminary analyses. 

P a rent ch a racteristics a nd child outcomes . Table 35 summarizes the 
relationships found between fafnily characteristics and child outcomes, 
independent of treatment. The most cons i stent pattern of associations 
occurred between mother's edUcatiori arid the child gUtcbme variables: twelve 
df the fourteen variables showed significant positive associations with the 
highest educational level attained. Correlations were low but statistically 
signivficant, ranging from-. 12 to .23- When the sample of families was 
divide^ into those with less than high school and high school or better on 
mother* s\educational level, differences between these groups were significant 
The directs^on of . d i f ferences favored families with higher levels of education 
No conclusibn about the relation between maternal education and child outcome 
above and beyond the effects Usually attributed to social status can be 
reached at thisvpoihti however^ since education is a cdrripdneht iri UsUal 
definitions of social status. 



Table 35 



Relation of Family Characteristics to Grade 1 
Child butcornes, Disregarding Treatment 



J 

Child Gatcome 
Variables 


Family Characteristics 

Mother's Farrii ly Aririua 1 Family Mother's 
Education Income Structure Employment 




r = .135 
1<2 (P=.003) 


r = .182 
i<2 (P=.010) 


1<2 (=.009) 





BSM-Spanish 










PI AT- Reading 


r = .180 
j<2 (P=;0001) 


r = .219 
j<2 (P=;0002) 


i<2 (P=;005) 




PIAT- 

Mathemat ic? 


r - .217 
1<2 (P-.OCOl) 


r = .197 
1<2 (P=.0002) 


1<2 (P=.02l) 




PIPS 


r — . 1 oy 
1<2 (P=.000l) 






1>2 (P=.0O8) 


POCL-l : 
••Tas:k 
Or iehta t idh" 


r = . \ io 
1<2 (P=.0002) 


r — . 1 b/ 
1<2 (P=.022) 




1>2 (P=.047) 


pnri -9 - 
"Sociabi 1 ity" 


r = ;118 
1<2 (P=.030) 




- - - - - 




CRS-1 : 
^'Self- 
Assurance^' 


r ,13^ 
1<2 (P=.006) 


r = .125 
1<2 (P=.020j 




1>2 {P=.OO01) 


b rl p I- — *5 • 

•'Aggres- 
siveness" 











CRS-3- 

"Dependence" 


r = -.140 
1 2 (P=.038) 








CRS-5: 
Academic 
Mot i vat ion" 


r = .163 
r<2 (P=.0007) 


r = .120 
1<2 (P=.01l) 




1>2 (P=.0001) 


CI-1 : 

"Attitude to- 
ward Teacher" 


r, not signifi- 
cant 

1<2 (P=.025) 








CI-2: 

"Interest in 
Read 1 ng" 


r = .228 
1<2 (P=.002) 


r = .li}i| 
1<2 (P=.Oi»0) 




1>2 (P=.008) 


1 IQA^ 1 lllUill II • 


kSS 


419 


459 


^59 


Dichotomized 
Variable Cate- 
gory Descrip- 
tion 


1 : less than 
High School 

2: H.S. dr 
better 


1 : tess than 

$8eoe.- 

2: $8000;- or 
mo re 


1 : s ingle- par- 
ent family 

2: two- pa rent 
fami ly 


1 : mother 
employed 

2: mother not 
employed 



Note: Table entries are product-momeht cdrrelatibh coefficients and direction of 
O . differences and P levels for F-tests; only entries at X = .05 or lower levels 

JC are included. 



Seven of the fourteen child butcbme variables showed significant 
associations with annual family incane ; another component of social 
status. 0nce^aga|n, correlations were low, and the direction of relatiori- 
ships was as one might expect: higher income levels are associated with 
more favorable outcomes. 

Significant assoc iat ions between the fami 1 y structure variable and 
child outcomes occurred only for the three outcome measares most clearly 
related to traditional views of academic progressj the BSM-Engl Ish and 
the two PiAT subtests, ^^jidren from single-parent families did less 
we Vr than chi Idren from two-parent families on these threis variables- 
Interest ingly enough, however, no differences between these two groups _ 
appeared on any of the other outcomes related to other aspects of sbcia] 
competence, such as iriterpersdhal style (the PIPS, CRS-2 and CRS-3, Cl^l), 
task briehtatloh (POCL-1), or academic motivation (CRS-4, 01-2). 

Finally, significant associations occurred for five child outcome 
^^'"'^^1^^ with mother* S-empjxxymerLt . Children in families in which mothers 
f^^.^"^? ^^^''^^ more favorably than children of families in which 
mothers are not employed. The pattern of outcome variables showing 
differences is somewhat surprislhg In its cdhsistericyj and almost opposite 
to that shown for family structure: nc differences appear inthe more 
traditionally academic measures ^ _ but cl ear differences on variables 
related to interpersonal style (PIPS), tasi< orientation (POCL-1, ERS-1), 
or academic motivation (CI-2, CRS-^) . The possibility that mother's 
employment Is serving as ah additiohal Indicator of social status in 
th]s sample should not be Ignored in considering interpretations of this 
finding. 



The Assdciat ion Between Teacher Background Characteristics, or Teacher 
Outcomes, and Child Outcomes 

Issues in cross-domain analyses . The present report presents initial 
explorations of relations between teacher and classroom doma in measares 

?5l 1^_9°?^°^^?- __^9^^^?r» ^ number of Issues obscure the selection of 
the appropriate units of analysis in crossing from the teacher or classroom 
domain to the domain of child measures. 

By way of contrast, analyses exploring the assoc iat ion .between family 
characteristics and child outcomes offer hbambiguity in definition of the 
appropriate unit for analysis: fbr each child in the sample there is one 
family, and vice versa. For each teacher or classroom, oh the other hand, 
there is generally more than one child. Further, the number of children 
for each teacher or classroom varies widely (and varies along different 
ranges for PDC and comparison groups): This situation poses a number of 
issues for which resolution is not straightforward. The issues can be 
summarized in the fol lowi ng quest Ion : to what extent is i t • reasonabl e to 
expect that associations betwiaeh teacher characteristic and 
child measures can be rel iably idehtif ied when samples of children for each 
teacher are smalls of varied sizes and possibly unbalanced? 



In spite of the potential problems, it does seem reasonable to assume 
that the chiidreri in the PDC evaluatidh study sample have been allocated 
to their teachers i h riphsysterriat ic ways. in the light of this assumptioh, 
it v;buld seem -Aorthwhile, as a first approximatiph, to explore whether 
there are any consociations across domains. I f significant assbcjat ions 
are found, -further analyses using strategies to (1) balance samples of 
children by groups or (2) seiect subsamples of classrooms with the most 
children or with similar distributions of children per classroom might Be 
expected to show even stronger associations. In other words, assessment 
of associations between the teacher and child varfables without efforts to 
restructure the sarhpje provide highly conservative tests of association 
between these variable dbmains--if the assumption of nohsystemat ic assign- 
ment of children to teachers is warranted. Since the validity of this 
assumption has not yet been tested, associations across these domains, are 
highly tencaiive at this point in the analytic process. 

One further point deserves mention. Two alternative approaches are 
used to examine assbciatioris between teacher and chi Id domains ; using 
teachers and using children as the unit of analysis. The child level Uses 
repeated non-independent data (the teacher domain data) and thus_over-_ 
estimates effects by using more degrees of freedom than are really available. 
The teacher or class l^evel weights each chi|d^s score differently, depending 
on the number of children in a given classroom. There are clear problems 
with both approaches. For the exploratory purposes of this report, both 
approaches have been used and findings are presented only when both approaches 
agree on the direction and significance of associations. 

Variables and analytic methods . Three teacher background characteristics 
and nine teacher outcome variables were examined for their assbciatlon wi th 
child outcome variables. The teacher variables are listed below. Defihitiohs 
for these variables are offered in Volume I of the present report. Thirteen 
child outcome variables for grade 1 (spring 1979) were examined. 

Teacher background cter^act^r-i-st-lcs^ 

• number of years teaching at this school 

• educational level ^ 

• " teacher gender 




9 freduency of committee or task force participation 



• extent bf parents' educational activities in the classroom 



• attitude Coward increased parent involvement in the classroom 



# frequency of use of community resources 



• extent of training in child development 



• Factor 1: program adaptation of individual children 

• Factor 2: extent of stracturing of activities m language 
arts and mathematics 



• Factor 3* teacher's efforts to involve parents arid the home in 
class activities 



• Factor extent of individualization of activities in language 
arts and mathematics 

Variable associations were examined through the use of product-moment 
correlations, where appropriate, and analyses of variance. Child outcome 
variables were not corrected for entry- level d i ffererices , so that all of 
the available analytic sarriple could be used iri theseexploratbry analyses. 
For each variable asspciatioh examined^ separate analyses were conducted, 
using teachers arid children as the analytic unit. We present the findings 
below only for those associations where the results for both levels of 
analysis (child and teacher) were in agreement as to significance and 
direction. Among the l6S associations examined, there were 10 cases where 
the results were inconsistent: in nine of the cases the findings were 
sighificaht at the child level but did riot reach sigriificarice at the 
teacher level of aria lysis. 

Teacher background character I st ics and child outcomes . Table 36 
summarizes the associations found between the three teacher background 
variables and grade 1 child outcome measures. 

The variable n u mber of ye a rs t ea ching a t this school a-ppears to be 
negatively associated with teacher ratings of child aggpessivenes^ and 
dependence (CRS-2 arid CRS-3 scales). Teachers with fewer years teachirig 
showec' a teridericy to rate chi Idreri higher dri these two scales. This, 
firiding might be_ iriterpreted as iridicatirig a degree of teacher bias iri the 
assessment of childreri's interactive characteristics iri the classrbbm-- 
a bias whose direction chariges with experience. No other child outcome 
variables based oh teacher ratings showed consistent relations with teacher 
background character is t ics . 



Teacher's educ a t i ona 1 1 e vej- showed a significant association with 
both of the scales of the POCL: the POCL-I "Task Or i eritat Ion*' scale and the 
POCL-2 "Sdciabi 1 i ty" scale. Iri both cases, :teachers with the highest 
educational levels terid^d to have_chi Idreri iri thel r .classes rated higher 
on thesescales by the testers. The same pattern of assbciatldn appeared 
for the Ci-2 "interest in Reading" scale: teachers _wl th higher educational 
levels were linked to children with higher levels of Interest In reading. 




Finally, teacher's gender appea red rel ated to levels of i-nteres^t 
I h read j rig : rhale teachers were linked to children with less Interest 
in reading than were female teachers. This does not seem to be. a site- 
specific effect, since the male teachers were spread out over six of the 
eleven sites. However, the small number of male teachers in the sample 
(eleven) .adds to the difficulty oF interpretation of this finding. 

The child outcome variables which show no relationships with teacher 
background may be of as much interest as the child dUtcdme variables which 
do show assdciatibhs with teacher background^ None of the more traditionally 
"academic" child outcome variables (the BSM-English and Spanish and the 
two.PIATs) show consistent associations with the three teacher background 
variables examined. Instead, associations are found between teacher 
background characteristics and task-related and interpersonal competence 
assessments: 

Of thirty-nine possible assdclatidns tested, six show relations th?t 
are statistically significant at the a= .05 level or bettel — much bettisr 
results than those one might expect at random. Table 36 presents these 
results. These findings are encouraging; since they are based on two _ 
separate (but not independent) analyses in each case, and since there Is 
reason to believe that the degree of association found is a highly con- 
servative estimate of the relation that might actual ly exist, [t appears 
wdrthwhije to cdntihue to examine the possible relationships between 
teacher background characteristics and child outcomes. 

Teacher outcomes and ch i 1 d outcomes - _ Table 37 summarizes the 
associations found between teacher variables that might be considered 
modifiable by the PD6 program and child outcomes. As the table shows^ 
they are few and somewhat scattered. 

interviewers' ratings of the e xtent to which te a chers permi -txed 
parents to undertake educatidhal activities j-n -the— c4^S-roQm^ (as opposed to 
inviting them only for rdutihe_pareht conferences) was positively asso- 
ciated with scores on the BSM-Spanish , In spite of the fact that the 
sample of childrenwhb took the BSM in Spanish (and of their teachers) 
was quite small: 82 children, and 22 teachers. This measure of teachers* 
behaviors with regard to parent involvement was not consistently associated 
with any other child outcome. 

the rated extent of teacher stract u ring of act! vl t 4Les--Ln- language arts 
and mathematics was assdciated with student scores on the BSM- E ngl ish . 
Teachers who were rated by the observers as providing relst ively more 
Chi Id-cennered activities or as structuring a heterogeneous mix of activities 
for these areas had children with higher BSM-Eriglish scores than did teachers 
with a more teacher-centered, homogeneous approach. 

A second composite measure derived from the Teacher Interview gldbal 
ratings, the extent of teachersJ efforts to adapt the educational j^rbgram 
td the needs -of- individual chl Idren, showed significant associations with 
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Tabte 36 

Relatibh of Teacher BackgrbUhd Characteristics to 
Grade 1 Child OatcbnieSi Disregarding Treatment 



Child Outcome 
tfariables 



Teacher Background Characteristics 

Number of Years Educationa] Teacher 

Teaching at Their School LeveJ 



Sender 



BSM-En§l ish 



BSM-Spani sh 



P.I AT- Reading 



PiAT- 

Math e m a tics 



PIPS 



POCL-1 : 
"Task 

^irJjentatibh" 



1,2<3 (P=.b29) 

1 ,2<3 (P^^omL 



POCL-2: 
"Sociability" 



1<2,3 (P=.( 
i<2.3 (P= . 6 l7j 



CRS-1: 

"Self-Assurance" 



CRS-2: 



res s i veness 



T: 



1>2 



(P=. 



CRS-3: 

"Dependence" 



1>2 
1>2 



(P=.010) 
(P=.0001) 



CRS-4: 
"Academic 
ilotivatibh" 



CI-1: 

"Attitude toward 
Teacher" 



CI-2 

"Interest in 
Reading" 



T: 1,2<3 (P=.020) 
C: 1,2<3 (P=.011) 



T: 
C: 



1<2 (P= 
1<2 (P= 



Maximum ri : 



159 

Teacher- 
1 eve 1 



m 

Chi Id- 
1 evel 



161 nS7 
Teacher- Child- 
Jevel level 



161 

Teacher- 
level 



496 
Child- 
1 evel 



Variable Category 
bescript ions : 



1: five or fewer years 
2: six or more years 



1 : 4-year col lege 
degree or less 
2: credit toward M.A. 
3: H.A. or bet4:^ r 



ma 1 e 
f ema 1 e 



Note: Table entries are the direction of differences and P levels for ^ or F tests; 
only entries at X = .05 or lower levels on both ana lyses us i ng teachers and 
chlr&^as units of analysis are included. T = teacher -level , C = child-level. 
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Table 37 



Child datcomes; Disregarding treatment 



Child 
Outcbnie Variables 


Teacher Outcome Variables 

Parents* EdUcatibhai Factor 1: .Program Factor 2: Structuring 
Activities in the Adaptation to of Language Arts and 
Classroom Individual Children Math Activities 


BSM-Engi ish 






T: 1,3,2 (P^.OOOl) 
C: 1,3,2 (P=.000l) 


BSM-.Spanish 


T: 1 ,2,3 (P=.036) 
C: 1<2<3 (P=.0004) 






Pi AT- Reading 


_ 


- - - - 




PIAT- 

Mathemat ICS 








MSCA- 

Verbal Fluency 




- 


_ _. _ . _ 


PIPS 








POCL-1: 
"Task 

_ Or i en tar ionli 


- -- 


. 





POCL-2: 
"Sociabi 1 i ty" 








GRS-1: 
"Self- 
Assurance" 




T: 1 .3,2 {P=.eG5) 

^ i<3,2 (p=.ee)3) 




CRS-2: 

"Aggress i veness" 








CKS-3* 

"Dependence" 








CRS-4: 
"Academic 
_ Mot 1 vatXonj ' 




T: 1,3,2 (P=.049} 
6: 1<1,3 XP^aiB) _ 




ei-1: 

"Attitude to- 
ward Teacher" 


- - 


— 




Ci-2: 

"interest in 
Reading" 








Maximum h: 


159 489 
Teacher- Ch i 1 d- 
level level 


162 497 
Teacher- Chi Id- 
level level 


162 ; 497 
Teacher- Child- 
level level 


Va r 1 ab 1 e 
Category 
Descri pt Ions: 


1: none of the parents 
2: some 

3: most of the parents 


1-: low Ihd ividual - 
izat 1 dri 

3: high individual- 
ization 


1 : teacher-centered , 
hbmbg . 

3 : ch i 1 d'-cehtered , 
heterog. 



Note: Table entries are the directiph of differences and P levels for tests; only 
entries for which a = .05 or lower levels oh both analyses usin§ teacher and 
children as analytic units are included. T = teacher- 1 evel , C = chi Id-^level . 
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twd.ratihgs of the children by teachers: the £RSrX l^e^lf -Assjgrance'* 

scale and the ''Academic Mat-iwtlon'- scale: These associations occur 

between two different assessments obtained from the same source (the 
teacher). The Implication is that those teachers who saw themselves as 
trying the most to adapt their educational efforts to individual heeds 
were also the ones who rated their children highest oh personal and 
academic competencies. 

Six other teacher outcome variables showed no consistent association 
withchild butcdmes. These teacher outcome variables are : freq u ency of 
committee or task force participat idh; attitude toward increa-S4^ parent 
involvement In the classroom; frequency of use of cdplurijty resources ; 
efforts to involve parents and the home Vn class activities; individuali- 
zation in language arts and mathematics activities; and amount of training 
in child developmept^ 

Only four associations were consi stently Identified, as Table 37 shows, 
but of 117 possible associations- Although this number of associations 
could be found by chance, it is Impbrtaht to remember that we are using 
quite conservative standards fbr these explbratbry analyses, and that the 
associations identified are restricted tb bh]y three teacher outcome 
variables. The humbef becomes more encouraging when we cdnsider that four 
associations are significant for 39 tests on three teacher butcome variables. 



The Interact ion df Other Study Mea^sures^ 
Treatment in Relatidri td Grade 1 Outcomes 
fbr Chi Id reh 



In this section, wo address briefly the following question: tb what 
extent db variables other than treatment help explain treatment'-rejated 
differences in grade 1 child outcomes? This question breaks down Into two 
separate quest Ibhs: 

• Are there Interactibns (that is, ndn-additive effects) between 
educational treatment and parent backgrdUrid, teacher background 
or teacher outcome variables? 

• Do these other measures help account for treatment-related 
differences in child outcome measures, or are thei r contr i butj^dns 
td child outcome measures separate from the effects of treatment? 

In reality, these twd questions are not separate. J f there are no 
Interactions between educational treatment and the other study measures, 
then It is likely that the cbntri but ibhs dt educat iona 1 treatment and the 
other measures to explaining variatibri in child outcomes will be separate. 
The second question Is Included because the pbssibility also exists that, 
after other study measures have accounted for varratibh in child outcomes. 



therewill be hd rema i hi hg effect of treatment/ If this is the case, 
we. will have to look for relationships from ecfucatidhal treatment to 
other study measures arid then to child butcorh^s. 

As noted earlier, the analyses, conducted to explore associations 
between educational treatment, olher study measures in the family and 
teacher domains, and child outcomes are preliminary. The process of 
construction of an analytic model is still in its early stages; only 
cross-sect idha 1 data across domains are available; and the sample of 
classrooms and teachers Is hot balahced with regard td the sample df 
families and children. The purpose of these analyses is to ddcumeht the 
extent to which interactions occur and to identify analytic problems, to 
form a basis for further work. 

An a lytic method s^ . To examine the first question, the presence of 
interactions between educational treatment and other study measures in 
relatidh CO chi Id outcdmes, we dichdtdmized the predictdr variables, 
created dummy variables to represeht them, and created dummy variables td 
represent the I nteract ion between treatment and each other predictdr. We 
then contrasted restricted and unrestricted reg ress ion models , in which 
predicted scores on each child outcome measure are used as dependent 
variables. 

The second question was examined by constructing a multiple regression 
model fdr each df the child dutcdme measures. Other study measures were 
entered first i_h these _ regress idh equatidhs, arid theh the additional 
contribution of educational treatrheht was examined. 

Variables used . Four sets of variables were used in the analyses 
for this section: child outcome measures, faml ly background character- 
istics, teacher background characteristics and teacher outcomes. Only 
those variable pairs for which significant univariate relationships with 
child dutcdmes were identified in previous sections were used 'h analyses. 
While ihteractidhs ffiight be found where there are no main effects, both 
the anticipated difficulties ih ihterpretatidn ahd the expldratory, 
preliminary nature of these analyses lead us td decide td restructure these 
analyses to an examination of interactions only where ohe or bdth of this 
main effects (either treatment or the other study measures) have beeh 
previously jdehtified- The child outcome variables used Include the thl.rteeh 
child outcome measures used in the orevious section: 

• BSM-English and BSM-Spanish 

• PIPS 

• PIAT-Mathematics ahd PIAT-Readihg 
- • POCL-1 and P0CL-2_scales 

• CI-1 and CI-2 scales 

i CRS-1, CRS-2, CRS-3 and CRS-4 scales 
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Four family background characteristics inclade: 



i mother's educational level 

• annual fami ly income 

• fami ly structure (as single-parent or two-parent families) 

• mother* s employment 

Teacher backgrounS characteristics inclade; . 

• number of years teaching at the school 

• teacher's educational level 
m'" teacher gender 

And the teacher outcome variables are: 

• extent to which parents are alloweB to undertake educational 
activities In the classroom 

• program adaptation to individual children 

• s'tructurihg of activities in language arts and mathematics 



The interact ix>n^o£ Educational Treatment and Other Study Measures with 
^hXl d Outcomes 

A total of sixty^three variable pa i rs were- exam i ned for interactjon 
with treatment. Three ihteractjons were identified. Since this is the 
"number of interactions. that would have been identified bychance' If there 
v/ere only raadom associations (using a = .05)^ arid since the interactions 
identified are not readily ihterpretable, they are reportedohly in 
summary manner. An interaction occurs between: educational treatment and 
mother's educational level in the PLAT- Read i ng , but disappears if the 
Georgia site (which has low scores and no comparison groqp^ and can 

reasonably be interpreted as a site-specific effect)^is removed: educa- 

tibnal treatment arid mother* s employment with relation to the Ci-2 llinterest 
in Reading'^ scales arid educatidrial treatment and structuring of activities 
In language arts and mathematics in relatiori:td the CRS-3 '^Depen d en c e" 
scale. 

It seems reasonable to conclude that the variables examiried dbridt 
have significant interactions with educational treatment In accounting 
for variation in child outcomes, because of the few and widely scattered 
iriteractldns obtained for all those examined. 



Additional Contributions of Educatiorial Treatmerit to Chi-l d Outcomes , d vBX- 
and'Above the Contributions of Other Study Measures 

In light of the exploratory nature and the complexity of these artalyses, 
sequential multiple regressions were conducted only for the PIAT-Readirig arid 
BSM-Eriglish measures. These child outcome variables were approximately of 
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interval scaie, had shown scgnificant treatment-related impacts, and were 
of a more "academic'' nature. We conducted these exploratory ahalyses to 
see whether, once variance in the_butcdme measures associated with parent 
arid teacher variables and site effects were removed^ effects of educatlbrial 
treatment pers i sted . 

Family backgrcand characteristics were the first 9roup of var[ables 
used as predictors. As expected, they explained significant proportions 
of outcome measure variance. Dummy variables for site effects then explained 
additional amounts of variance. Teacher outcome variables were then added, 
followed byeducatioha] treatment, Variables frdrri each of these groups 
made significant add i t ional cbnt ri but ions . Ah example of such a regression 
equation sequence ^s shown in Table 38, which illustrates that both teacher 
outcomes and educational treatment make separate additional contributions 
to explaining variation in the grade one Pi AT^Reading, after the effects 
of site and family background sre removed. if this finding is confirmed, 

it would suggest that these particular changes in teacher characteristics 

are hot the ones cbht r i but i hg to educational treatment differences. However, 
such conclusions are highly speculative at thispbiht: cbricjusibhs are 
unwarranted until a larger set of teacher and classrbbm-level butcbme 
variables are Available, until thesr reialibn to educational treatments in 
both PDC and comparison schccls is understood, and until issues in selectibn 
of appropriate levels of analyses for child outcomes are corifrbnted. 
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Table 38 



Results of Stepwise Multiple Regressions on 
Grade 1 PIAT-Readihg Scores (n=329) 



Variable Sets 


R2 After 
Inclusion 


Add i t ioria 1 
F 


Contribution 
P 




.66 


11 .03 




1. Parent Background 
(2 var.) : Mother' s 
Education and Family 
I ncome 


.0001 


2. Site (3 dummy variables) 


. 10 


3-03 


.926 


3- Teacher- level Outcomes 
(4 dummy variables) 


.14 


3-65 


.007 


k. Educational Treatment 
(1 variable) 


.17 


11.10 


.001 



Notes: Data for Georgia site are excluded. 

The order of variable sets in the table reflects the order of_ 
ihclusibh in successive regression equations, in Which variable 
sets appearing earlier are fixed. 
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VI 

SUMMARY: eflltD SUTeeMES AT FiRST GRADE 



The drgahizat idh\of this* chapter jDarallels that of Chapter V. PDC's 
impact bri chi Id butcomev measures is examined first; succeeding sectibhs 
examine the study's finding on the relation of measures across domains 
independent of educat lonaV treatment , and the extent to which other vari-- 
ables modify the re lat ions petvveen educational treatment and child outcomes. 
A final statement sammarizes\the findings in general terms and analyzes 
their Implications for futureMata collection and analysis. 



PDC*s Impact on ChXld Outcome Measures 

^ 

\^ 

The analytic approach to child o tc^me measures involved a sequence _ 
of three questions, each of which was aime^ at a different type of overall 
comparison of test scores for children in the PDC program with children in 
the comparison groups- The questions were: \^ 

(Question 3: Considering outcome variablei\,one at a time ^ are 
PDC and comparison children different from one 
another at the end of first graSe /(spring 1979)? 
In pariicular^ are there group main effects or 
croup-by-site interactions? 

Question k: Considering all outcome variables sinkitianequsly^ 
are PDC cznd comparison children differ^t at the 
end of first grade (spring 1979)? In pax^icular^ 
is there /a group main effect or group-by-^te 
interactions? '^s^ 

Question 5: CoT^idering ail oaaaeions of measurement of each 
child outcome vccriahle from fall 1979 through 
spring 1979'^ are there tren& and paiterns over \. 
time in group differences or group-by-site inter-\ 
actions? \ 

Analytic methods used for each of these questions are discussed in detail 
in Chapter V. Findings are summarized below for each i ristrumerit . The \ 
sammarizat ion is restricted to analyses for the sample testedih English.'-^ 
The sample of chi Idren tested at some times in Spanish was analyzed _ v 
separately, but complete analyses cannot be reported due to problems in 
interpretation associated with reduced sample size and gross imbalances 
in d istribut idh across sites. 
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Summary of Firidtrigs for Child Dutcome Measures 

Peabody |nd|v?dual Ach ievefnent J-est-Read i ng ♦ A significant main effect 
favoring the comparison group was found in analyses of gNde 1 scores for 
the s-everal outcome variables separately (question 3) and for the dutcome 
variables cons idered together (questfon 4). The magnitude of the effect 
was approximately .19 of a standard deyiatidri. When the low scoring PDC 
sample from the Georgla sLte^ which had ho ccaiparison group, was removed 
from the analytic des ign- for _the separate analyses for each outcome variable 
(question 3), the overall difference between groups disappeared- No group 
effect was found in the analyses of trends In outcome variables over time 
(question 5)- 

Significant group-by-si te interactions were fdund in analyses for all 
three quest ions relating to child outcomes. In each case ^ post _ hbc tests 
indicated that the Michigan site's comparison group had a significantly, 
higher mean PIAT-Readihg score than the P.DC group- Post hoc analyses of 
the interaction of trends in outcome variables over time (quest ion 5) 
further i nd icated : 

• a main effect over two occasions favoring the comparfson 
group in Florida, 

• higher rates of gain from spring kindergarten, to spring 
first grade by comparison grcfjps in both Michigan and 
Cal ifornia , and 

• a higher rate of gain from kindergarten to first grade by 
the PDC group in Colorado. 



McCarthy Scales and Children's Abilities-Verbal Fluency . S ighi f i cant 
group-by-site interactions were found in analyses for all thr.ee questions 
about child outcomes. Post _ hoc anal yses revealed "that these interaction 
effects were due to group differences at two sites: the PDC group was 
higher than the comparison group in Maryland, while the comparison group was 
higher !n Washing tori. 

BilinguaJ Syntax Measure-English . A significant effect favoring the 
comparison group was found in analyses (question 4) with all outcome variables 
considered together. The magnitude of the effect was small — .13 of a standard 
dev iat ion . 

Child Rating Sca1e-2 "Agress i veness" scale . A significant affect over 
time favoring the comparison group was found in question 5 analyses, trends 
in outcome variables over time. Post hoc aria 1 yses of a significarit group- 
by-site interactiori for this measure revealed a significant site-level 
difference only in Michigan. The magnitude of the effect was small — .15 
of a standard deviation. 
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ChMd RaiXQg_-ScaI^3- llBependenc^ scale . A significant effect 
favoring the comparison group was found »n qy^stlon^ ^^^Iv^^?!.^!^'^ 
dutcome variables considered together. The magnitude of the effect was 
small--. 11 of a standard deviation. A significant groap-by-site Inter- 
action was found in question 5_ana 1 yses trends in outcome variables over 
time^ revealing a trend over time that favored the comparison groups in 
Florida and Connecticut. 

£hjj-d- .Rating. Scale-^ ^'Academic Motivation" scale . A significant 
effect favoring the PD6 group was found !n question k analyses, with all 
outcome variables considered together. The magnitude of the effect was 
small — .19 of a standard deviation. 

Pupil ObservatibhCheckl ist-2 "Sociability" scale . A significant 
effect over time favoring the comparison group was_found In question 5 
analyses, trends in outcome variables over time. Differences between 
groups did not reach statistical significance at any single.point in time. 
The magnitude of the difference was relatively small--. 25 of a standard 
devi at ion . 

Spring, 1979 outcome profile . Question 4 analyses, which considered 
all spring 1979 measures simultahebusly, indicated that outcome profiles 
for the two groups were significantly different- Differences for particular 
measures, however, were inconsistent in their direction and so small 
(cf: the estimated magnitudes of effects described above) as to be of 
dubious educational consequence. 

Interpretation of Child Impact Flnd4ng-S^ 

Our interpretation of the findings for child outcome measures through 
the cohort's first grade (spring 1979) is as follows. First, the set of 
measures appears overall to have met the psychometric. standards established 
for the child outcome battery; it also appears to be identifying variation 
among children. The bulk of such variation, however, appears associated 
with differences between sites and within groups, rather than being 
associated with differences between PDC and comparison treatment groups. 
Second, the aha 1 yt i c approaches used In this report seem appropr[ate for 
the task of identifying differences between PDC and comparison groups, 
since they provide fair consistency In their findings across a variety of 
approaches. Third, the analyses carried out discriminate between treatment 
groups and identify outcome differences, but thesedifferehces as of the 
end of first grade are too small to be educationally meaningful. On the 
basis of these findings, it is our sense that if there were educationally 
meaningful differences between PDC and comparison children within the scope 
of the outcomes measured, our ana-iytic procedures would be adequate to 
identify them. 



Dh the basis of our anajyses of Impact on chMd outcome measures fdr 
grade one we conclude, therefore; that there ape-rio s i gri I f icarit , educat ioha 1 1 y 
Iriterpretable differenc es over a ll betwe ^-PDC and comparisbh groups of 
ch i 1-drjen - 

Some differencies at the_]evel of _ individual sites do appear between 
PDC and cdrnparisbn groups. Site-level analyses and finoings, however, are 
not appropriately conducted with the same techniques used for overall, 
acrbss-si te Chi Id outcome measure analyses. Covariate adjustments that 
appropr iate]y correct for |nitia] overall entry-level differences may leave 
large entry-leve] differences between groups at particular sites, and these 
residual differences may in turn be affecting site- level butcome differences 
between treatment groups- As data analyses at grades 2. and 3 a'-e conducted 
we intend to cons i der s i te- 1 eve 1 phenomena in greater depth, utilizing 
procedures specifically tailbred to site-specific analyses. 

"^he issue of s i te-speci f |c effects and their connection to entry-level 

differences is related, in jts implications, to another finding in this 
volume^ that the samples of PDC and comparison chi Idren ayai lable fbr 
testing in spring 1979 are no longer fully comparable. PDC children were 
found to have lower entry- level test scbres_than comparisbn children. 
Univariate analyses revealed s i §n i f i cant d i f f erences on two entry-level 
tests; multivariate analyses indicated that entry-level test score profiles 
were different fbrthe two groups. Though these differences were not large, 
they, cons i stent 1 Y favored the comparison group. No group differences 
appeared on demographic variables. The Issue of the changing comparabiUty 
of PDC and comparison members of the study cohort will be a specific focus 
°^_^"^J future; our aim will be primarily tb come tb 
understand how it happened. 

It is the lack of comparability bf PDC and cbmparison grade one groups 
of children oh entry- 1 evel test data that made covar iance-based adjustments 
necessary for between-group comparisons on grade one child outcomes. 
'Although these techn i ques seem appropriate for cross-site analyses, they 
Irncrease the complexity of interpretation of site-specific effects. The 
approach of conducting separate site-specific adjustments for each site 
(which amounts to treating each site as aseparate replication of the PDC 
experience) has its own drawbacks: The advisability of such an approach 
will be exaniined in reference to future analyses. 



The Relation of Other Study Measures to grade 1 
Outcomes, Regardless of -Tr£ia-tmerLt 

Preliminary analyses were conducted to assiess the presence and extent 
of relations between chi Id outcome measures and variables measuring aspects 
of f ami I y background, teacher background and teacher attitudes and behaviors 
pbtientially ; nter pretab I e as prbgram "outcomes." These analyses are viewed 
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as preliminary because they are based oh only one year's data, because 
they precede the existence of a specified model of hypothesized relations 
between these doma^s^ and because t^^ make certain conservative assump- 
3-^n^_^^^^ trhe appropriate units for cross-domain analyses- The findings 
"from these analyses document the fact that cross-domain relationships can 
be identified for the study data base and that more systemetic cons iderat idri 
of these relationships would be worthwhile. 



Summary of Findings 

KamJ-l y background a nd child outcomes ^ . Family characteristics show 
consistent and positive associations with grade one ch i 1 d outcbrrie measures. 
The broadest range of such associations occurs for mother's education and 
family ihcdme . Higher levels of mocher's education and f am i 1 y i ncome are 
associated wjth higher scores on several of the child outcome measures. 
The_ correlat i ons were low but consistent and significant. These findings 
replicate the usually identified relationship between social status and 
achievement, since mother's education and family incoine are components in 
the usual definitions of social status. The fam ily struc t-ure variable 
(wh;ch distinguishes between single-parent and two-parent families) shows 
children of two-parent fami 1 ies scoring higher than chi Idreh of single- 
parent families dp the more traditionally "academic" child butcpme measures 
such as the Pi AT- Math , Pi AT- Reading and BSM-Eng 1 ish . The variable mother ' s 
employmeht shows children of families in which the mother is employed 
scoring higher than children in families in which the mother is not employed, 
on child outcome measures dealing with areas of interpersonal and task- 
related competency such as the Pi PS , POCL-1 "Task Orientation ," CI -2 "Interest 
in Reading ," CRS-1 "Sel f-Assarance ," and CRS-^ "Academic Motivation ." 

Teacher background arid child dutcdmes . Perhaps the most hdtable 
finding df assdciatidh between these two study ddma i ns is a negative one: 
none of the mdre trad i t idha 1 ly '*academic"_bf the child outcome measures - 
(such as the two BSM tests or the two PIAT subtests) show any relationship 
to teacher background variables. Instead, measures of teacher background 
show relationships with child outcomes related to task and interpersonal 
competencies. Thus, the variable number of years of teaching at this school 
is related negatively to eRS-2 "Aggressiveness" (with the teachers with the 
most experience rating the children as least aggressive), arid in the same 
way to CRS-3 ' 'Depehderice . " The teacher ' s educat idha 1 jeye 1 is related 
pdsitivejy to ratings df students _dh_ the; PQCL- 1 "Task Or i en tat ion" and the 
POCL-2 "Sociabi 1 i ty ," and to the CI-2 "interest in Reading ." 

Teacher outcomes and child outcomes . The observer's rating of the 
teacher's e xtent of strgctgring in langpage arts i n mathe ma tics activities 
in the classroom is associated with student scores on the BSM- E ngl i sh . 
Te^^chers with children with higher scores on this measure tended to be 
thdse who were rated as prdvidlng relatively more child-centered activities 
or a more heterdgenedus activity mix, rather than thdse teachers rated as 
providing a more teacher-centered, hdndgenebus approach. 




A second cdmpdsite measure derived from the Teacher Interview global 
ratings, the extent of teachers' efforts to adapt the edacatianaJ- program 
to the needs of individaaJ children , showed significant associations with 
two-ratings of the children by teachers: the CRS-1 ''Self Assurance" scale 
and the ^(XES- '4 "Acad enx-i^:^-Mo t i vat ion '* scale. Since these relationships occur 
between two different assessments obtained from the same source (the teacher)^ 
the irnp.l icat idri is that those teachers who saw themselves as_ trying the 
ha-dr-^t .to adapt tK^i r educat ibna 1 efforts to Individual child needs were 
• ' the •n^:^s who rated their children highest on these competencies. 



Interpretation of Varj_able Associations Independent of Treatment 

Associations between family background variable*:; arid child outcomes 
are not new or surprising; perhaps their most useful purpose will be for 
the Isolation of social status-re iated components of child outcome measure 
variation. The fact that different aspects of child outcome are tapped by 
the two measures of fami ly structure and mother's empl dyrrient suggests the 
importance of ah Ihspectioh of the ihteractidh of these two variables with 
each other. 

For the assessments of associations between teacher-domain and child 
outcome variables, perhaps the most significant statement that can be 
made at this point in the analysis sequence is that some relationships 
were found: Teacher background and outcome variables seem to be associated 
mostly with the less traditionally "academic" outcome measures, and in 
particular to bear some relation to teachers' ratings of their children. 



The i nteract Ion of E ducat lona 1 Treatment and Other 
Study Measures with Child Outcomes 

The research question that sparked the analyses undertaken for this 
section was: to what extent do other study variables modify the relation 
between educational treatment and chi Id dutcbmes at grade one?" Our highly 
preliminary answer to this question is "not much." While there are at 
best weak effects of treatment on the child outcome variables at the first 
grade level, ":here do not appear to be Interactions between educational 
treatment and variables in the parent and teacher domains, in relation to 
child outcome measures. Additional exploratory analyses ^ere carried out 
of the contributions of educational treatment to the explanation of vari- 
ation in child outcomes over and above the contributions cf family back- 
ground variables, between-si te differences and teacher outcomes. These 
analyses seem to indicate that the effects of the educat loria 1 t reatment 
are not confounded wi th .variables used from these ddrrialhs of family back- 
ground between-si te differences, and teacher outcomes. If pathways between 
educational treatment and child outcome are to be sought, the> .nust be 
sought elsewhere: Of coarse^ many available pathways have not been _ 
e;<p'lored: variables from different points in time; other variables from 
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the teacher arid parent domains (including parent "outcomes'' not explored 
in Current analyses); and a number of var iablies representing data collected 
on the classrooms _thrbLjgh direct bbservat rbh. Most significantly, a model 
of the sequence of impact of PDC, sufficiently detailed to allow. for speci- 
fication of analyses, stMl remains to be fully developed. The fevy findings 
reported in these preliminary analyses indicate that such a model Is r^equired 
if the large variety af findings from the many domains that form the Pt)C 
study are to be formed into a coherent whole. 

At the cbncluslbh of the grade one year of schoonng for the evaluation 
cohort, the evaluation findings for child outcomes are mixed. There are no 
educational ly meaningful and consistent differences between PDC arid com- 
parison students on the child outcome measures. There are some differerices 
between family background, teacher background, and teacher outcome variables 
and some child outcome measures- The impact of treatment (PDG versus com- 
darlsori) over and above other variables in explaining d if ferences in chi Id 

butcomes is nbt clear. However, the number of potential relationships 

among study variables in any brie year of schbb 1 i ng of the eval uat ion cohort , 
the additional complexity of the longitudinal analyses, the differential 
effects oh PDG and comparison samples of Ibss bf studerits to the longitudinal 
evaluation, and the technical analysis problems (such as_unlt bf analysis 
questions) indicate the need for careful consideration of the possible _ 
evaluation findings, in the form of the devel^opment of one or more models 
of possible relationships between PDC impacts. The model described In 
Chapter 11 is the first step in that development. As details of the model 
are ident i f i ed , ana I yses will be specified and conducted with the longitudinal 
data set from the evaluation bf Project Developmental Continuity. 
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APPENDIX A 
Child bevelbprrieht Measares 





During the course of the PDC evaluation a variety of-x;hIld measures 
have been selected and/or developed to assess program ef f ectT^frv-~the_ key 
domains of children's behavior and. development . The original battery^^of 
measures was identified during 197^-75, pilot-tested daring 1975"'76 and 
used at the Head Start level in 1976-77. With a few additions and 
deletions, this set of measures has been used in each testing period from 
Fall 1976 through Spring 1978. In Spring 1979, however, several changes 
were made to accdrhmddate the increasing age of the children and to be 
responsive to the expectations of public schools. Before describing these 
changes and the rationale for them, this section summarizes the purposes 
underlying the original battery (a more detailed description of the rationale 
for the original battery may be found in Interim Report M, Part B, 1975). 

the Original Battery 

The_measures administered in Fall 1976 were selected according to a 
number of criteria, Ihese_ ihcl uded (1 ) practical cons ideratlons (e.g., 
available for use in Fall 1975, appropriate for admi n i st rat ion by trained 
paraprofessiohals , reasonable testing time); (2) psychometric qual i ties 
(e.g., validity, stafajllty and internal consistency, representativeness 
of the standardization sample); (3) relevance to PDC (appropriate. age 
range, Spanish adaptation available, relevant to program gba|s^ likely to 
demonstrate program effects); and (^) past use (i.e., used in previous 
national evaluations or large-scale studies). In addition, one of the 
major goals of the evaluation during 1974-75 was to be sensitive to 
children's "social .competence." Consequently, several sources were reviewed 
for guidance on defining and measuring social competence. These included 
the Off ice of ehi Id Development 's 1972 statement (i.e., "an Individual's^ 
everyday effectiveness in dealing with his envl ronment ,,."); _the discussion 
of 29 competencies by Anderson and Messick ( 197^) ; reviews of the Rand 
Corporation for its design of a national evaluation of Head Start (Raizen 
Z BdbrdW^ 197^) ; and research on social-emotional behavior by White and 
Watts_I1973) and Cgilvie arid Shapiro (1973). An attempt was also mode to 
take PDC program ^bal s i ntp cdnsiderat ion by polling PDC staff regarding 
their expectations for children. 

Over a two year period the initial battery df_17 tests, two observation 
instruments and two rating scales (plus measures of height andweight) were 
modified so that by spring of the test cohort children's Head Start year 
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the battery consisted of five tests of . cbgh i t i ye Or language development, 
four measures of social-emotional develbpmerit (one test, two rating scales 
and a child observation systen)^ one psychomotor measure and measures of 
height and weight. Changes in the battery over time were based on assess- 
ments of six criteria at each testing point: internal consistency 
reliability, validity, sensitivity to change, relevance to ''social_compe- 
tence," suitability for use in the higher grades and ease of admi n i st rat ibi 



The SpriJte 

Although the original measures were selected with sbme attention to 
their cohtinued suitability as children became older, the maUi emphasis 
was on their use in Head Start. One of the chief concerns in program 
evaluations at the elemeritarv school level is school achievement, however, 
-^Rich, of course, was not represented in the PDe Head Start leve^ battery. 
fhus>-fsr Spring 1978 testing, when the test cohort was in kindergarten, 
an achievSSettl^lest was added tb the briginal measures. The rest of the 
battery remaine^^^i-l^raUar to the Head Start battery. At the first grade 
level (Spring 1979)se^7eol additional mod i f [cat lohs bf the battery were 
made. These included addin^^pa^^ ratings of children's progress in 
school and attitudes toward school ; ^di ng a child interview tb tap child- 
ren's attitudes toward their teachers and~-^ard reading; adding .an 
additional scale to the Child Rating Scale to ta>^cademic motivatPon; _ 
recording attendance, retentibri in grade, special education placement, and 
extent of ma Inst reaming; and deleting the child observation system, arm 
coordination, verbal memory and draw-a-c^i Id . The rationale for each of 
these changes is presented here, fol lowing a discussion of tne basic frame- 
work adopted for the Spring 1579 battery. 

During the first phase of the PDC evaluation, child measures were^ 
classified as soci a 1 -embt ional , psychomotor, and cognitive-language. In 
preparation for the current phase, considerable discussion took place 
between High/Scope and ACYF staff regarding the domains that should be 
represented in the child Dattery. These discussions were necessary because, 
although there has been considerable research and evaluation at the Head 
Start level, there are few precedents for studies that fol 1 ow Head Start 
Children into the elementary grades. TheclassI fi cations of measures used 
in three evaluations were reviewed (see Figurel) and found to represent 
very different patterns of organization. But in discussibns of 'domains 
severa-' themes continually emerged. First, in a program concernea with 
enhancing children's effectiveness in school, some measure of school ^ 
achievement r^-^t be included; regardless of the shortcomi ngs of _ typical 
^^a^dardized ..chi evemer.t tests, these tests represent politically impor- 
tant criteria For programs such as PDC. Second, ACYF and Hi gh/Scope^are_ 
Interested in going beyond the politically important criteria and selecting 
measures that are important from a program perspective: Thus, in the 
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Oociains and Heasures. Included ill Head Start and 
Follow Throagfi Evaluatibris Where Elementary 
Scfibdl Children Here Tested 



Follow through Evaluation Home Start Follow-up Study Head Start Transition Study 

iStebbins, etal., 19771 - (Abt S High/Scope) (Royster, etal., 1978) 

Basic Sh'lls ■ School Achievement Academic 

Word Knowledge (iT) Mathematics (PIATj Reading (MRATj 

Spelling (MAT) Reading Recognition (PIATj Spelling (WRATj 

Language (MAT) ____ _ . _ . " Wers (WRAT) 

Hath Computation (HAT) Social-Emotional Academic 



SiiMM iSifSi' '^^Pti,e mm 

Reading (MAT) ____ Attitude toward school (PSAS) So:ciability (Values Inventory 

Hath ConceptsjHAT) Attitude toward family (PSAS) .for Children).. 

Hath Problem-Solving_ (PAT) _ Social problem-solving (PIPS) Cenformity (fIC) _ 

Nonverbal Problem-Solving (Ravens) Tasic orientation (POCtj Friends named (Child Interview) 

Sociability (POCL) Extroversion (Schaefer) 

Affective-Cognit m Popularity (Schaefer) 

Self-Este« (eooperwlfi) . Sociatilitj (POCL) 

Locus of Control (Intellectual „ „ . . » d-l - 

Achievement Responsibility MJ^^m^m Mmor, 

Scale [+,-]) Asocial (VIC) 

He First (VICj 

Aggression (Bel ler Rating Scales) 
Hostility (Schaefer) 

Motivational 9rientatibri 
Academic motivation (VIC) 
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Task orientation (Schaefer) 
Autohbmbus achievement 
striving (Seller) 
Test orientation (PDCL) 

Closeness to adults (VIC) 
Child dependency (Bellerj 
^Wi.^6pendency (Bel ler) 
Dependency conflict (Bellerj 



dbmairi we call ^'academic skills and abilities" measures of cognitive and 
language develbpmerit are ihcltided. Also because of program emphasis; a 
range of measures In the domain that's commonly referred to as social- 
emotional or affective are included. For the purpose of PDC, we divided 
this area Into socIal-emotlonal development and learning attitudes because 
of increasing awareness of the Importance of attitudes and motivation as 
coricomitants of ach Leverheht arid general social competence. In recognitibh 
of the Irhportahce of the g rpwi ng chl 1 d * s _ phys i cal we] ] -bel ng , some 
measures of health and nutrition are Included. Finally, the classroom 
observation system (see Section IV of this appendix) afforded us the 
opportunity to obtain Indices of children's classroom behavior. Figure 2 
lists the measures used at first grade, organized by the four domains 
discussed above: 

(1) academic skillsahd abilities; 

(2 ) sbc i a 1 -erhpt i bha 1 deve 1 bprheri t arid 1 ea rri I rig a 1 1 I t udes ; 

(3) health arid riutrltlbn; arid 
[k) classrborri behavior. 

Description^ of eac^. of these measures are presented next. it should be 

noted, hov%' > - , that tnei-t^ ..^^j^sures d'^ not constitute a complete "mapping" 

of these aortiains since adJI:."onal reasures are planned for use at the 
secbrid and third grade. 



Descriptions of feasures 

Measures of Academ-ic Sko-IJ-s ^nd Abilities 

The seven measures of academic skills and cognitive-language abilities 
listed iri Figure 2 are bbtained from three tests ^ from the Parent Interview 
and frbm schbbl records. 



Pi At Word Recognition . The Word Rtcognltlbn subtest _bf the Peabbdy 
individual Achievement test (PiAt) was selected for admlnlstratlbn at the 
kindergarten level In spring and was continued ' Q 1979. Six standard 
reading tests and several Individual ly administered oral reading tests 
were considered before arriving at this decision.^ The selection process 
vvas focused ori "reading achievement" In general, so this discussion 
reviews the cbrislderatlpris Involved iri deciding Upon tests to use from 
kindergarteri thrbugh third grade, fdcUsirig on reading recognition at early 
grades and reading compreherisibri at secbrid and third grades. 



^Twb widely used tests were riot reviewed because they were considered In- 
appropriate: the Iowa Testof Basic Skills starts at too high a level-- 
grade 3; the Wide Range Achievement Test cdrisists orily of a list of words 
that mast be correctly pronounced but cannot be reliably "sbunded out." 
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PDC First Grade. Chi Id Heasureoient Battery 
Spring 19?9 



Jype-of Heasure^ 



Doinain and Construct 


- Test 


Inter- 

- view 


Teacher 
Rating 


Tester 
Rating 


Parent 
Rating 


' Obser- 


ACADEMIC SKILLS AND ABILITIES 
Reading Recognition 
Mathematics , 
Verbal Fluency 
Syntactic Development 

Progress in School 
Retention in Grade 
" Special Education Placement 


PIAT 
PIAT 
MSCA 

BSM-English 
BSM-Spanlsh 








PI 


Records 
Records 


SOCIAL-EMOTIONAL DEVELOPMENT 

^Social Problem-Solving 
. Attitude Toward Teacher 

'Self-Assurance 

Aggressiveness 

Dependence 

Sociability ' 

1 


PIPS 


CI 


CRS-1 
CRS-2 
CRS-3 


POCL-2 






LEARNING ATJITUDES 
Attitude Toward Reariing 
Academic Motivation 
Task Orientation 
Attitude Toward School 




ci 


CRS-i| 


POCL-1 


PI 


~ 1 



^Key to measures: PIAT: Peabody Individual Achievement Test 



MSCA: McCarthy Scales of Children's Abilities 

6SM: Bilingual Syntax Measure 

PI: Parent Interview 

PIPS: Preschool Interpersonal Problem Solving Test 

CI: Child Interview 

_CRS: Child Rating Scale 

POCL: Pupil Observation Checklist 

FO: Focused Observation 

CAR: Classroom Activities Record ' 

ERJC (continued) 



Figure 2 
(continued) 



I 



Type of Heasure' 



,\, Dbmain and Construct 

V 

LEARNING ATTITUDES (cont.) 
Engagement In School -Related 
Work at Home 
Attendance 

\, 

HEALTH, ANDWTRITieN 
Height for\Age 
Weight for , Height 

CLASSROOM B£HAV^O"r^ 
6hild-lnitiiated\nter- 
actions with Teacher 
Attention to Learning 
Respect for Parents \ 
Disruption 

Noise Level \ 
Respect for Teacivr/Alde ■ 
Coope ration with Teacher -V 



Test 



Inter- Teacher Tester Parent 
view Rating Ming Rating Records 



Obser- 
vation 



PI 



Records 



Direct 
Heasares 



F0 & CAR 
FO 



CAR 

FO 

FO 

10- 



^Key to measures: PIAT 
MSCA 
BSM 
PI 
PIPS 
CI 
CRS 
POCL 
FO 
CAR 



Peabody Individual Achievement. Test . 
HcCartVv Scales of Children's Abilities 
Bilinguk Syntax Heasure 
Parent Interview 

Preschool interpersonal Problem Solving Test 

Child intervfew 

Child Rating &le 

Pupil ObservatloVChecklist 

Focused Dbseryatl^ 

Classroom ActlvitleSyRecbrd 



^Classroom behavior measures are obtained from ttie Classroom Observation System and represent classroom- 
level indices of children's behavior, rather thanVthe child-level ineasures obtained In the other domains, 
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The oral reading tests typically ask the child to read passages aloud, 
whereupon the tester asks relatively open-ended cbmprehens|oh quest 1 oris. 
These tests. were hot selected for Use in the PDC evaluation for three major 
reasons: (l) the passages are put-dated and biased both in their middle- 
class, suburban, two-parent family orientation and in the tradi tiona^ sex 
roles'assigned to characters; (2) the cpmprehehs ibri questions often test 
world knowledge and logical reasoning skills rather than comprehension of 
the passages jpe£ ^e; (3) the tests are most sensitive for children with 
average, or above average, reading abiTui^es^ thus leading us to hypothesize 
serious "floor" effects with the kindergarten PDE sample. 

The Comprehensive fests of Basi c_ Ski 1 1 s was rejected due to peculiar 
test Items with curriculum bias and middle-class, suburban orientation in 
comprehension items which appeared to introduce genuine bias. The 

Stanford Achievement Test was rejected because the comprehension items 

require specific world knowledge not typically! acqui red_ through experience-- 
it resembles a social studies test. The eaHfornia Achievement Test was 
rejected due to a strong curriculum bias. Many Items tested subskills 
related to a particular approach to teaching reading and used jargon that 
would be unfamiliar to teachers and students in many programs . The^ Sequen- 
tial Tests of Educational Progress was rejected. Al though i t contai^ned 
some of the best paragraph comprehension items of any of the tests reviewed, 
it also included vocabulary and sentence comprehension items which were 
frequently unclear and/or strongly culturally biased. 

The PIAT has two reading subtests: Word Recognition and Reading 
Gomprehenslon. As noted earlier, the Word Recognition subtest Was selected 
for'admlnistratibn at the kindergarten and first grade levels.. It begins 
with letter recognition and moves to a WRAT-like word list. Although the 
word list seems inappropriate, like the WRAT, the early items seemed 
satisfactory and thus suitable for kindergarten and first grade but not .or 
second or thi rd -grade . The Read i ng_ Comprehens i on subtest was reject 3d . or 
use in the PDC evaluation. It invbWes single sentences which ^re read 
silently and matched to line drawings. It seems to have an unacceptably 
large membry component and some items are dated or culturally biased. 

The PIAT Word Recbgnition subtest is :hd[vi^dual ly administered and 
has Sk items ranging in difficulty from preschool through high schob] . 
Items 1-3 involve matching one br mbre letters with identical stimuli that 
musL be discriminated by the child from bther increasingly similar shapes 
in a mu!tiple-choi^ce~^rmat. Items. 10-18 present individual letters to 
be named, and Items IS-S^T^re. Individual wbrds to be read aloud. The 
subtest can be adminie-ered in about ID minutes tb first graders; 
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Thls_subtest was used in the Hpfne Start follow-up study (Bache S 
Nauta, 1979) with results that confirm its usefuinisss as a program 
evaluation 'measure. The fol lowing table compares data from the 
standardization sample (Dunn S Markwardt, 1970), the Home Start follow' 
up study and the PDG evaluation: 



Grade Level 


Standard i zat ion 


Hdnie Start 


Fbl low- Up 


PDC Evaluation^ 






SD 


Mean SD 


Alpha 


Mean SD 


Ki ridergarten 


11.9 


3.83 


15.6 4.3 


.91 


15.1 4.43 : 


Fi rst Grade 


21 .0 


5.15 


24.1 6.0 


.92 


22.8 5=73 


Second Grade 


28.7 


6.79 _ 


32.1 8.8 


.94 


Not Appl icable 



The publishers reporf one-month test-retest reliabilities for reading 
recognition pf-^-Sl for the kindergarten sample and .89 for the fi rst grade 
sample (the' i nterhal consistency , alpha, rel iab? 1 i ties reported in the 
Home Start study are undoubtedly inflated due_to the careful ordering of 
Items on the test and the testing procedure.of establ i shi hg_ basal arid 
ceiling levels rather than administering a fixed number of items to each 
Chi Id) . 

A major advantage of the PIAT, that applies to both the Recbgni^t ion 
and .Mathematics subtests, is that items are arranged jn ascending order of 
difficulty arid iridividual starting and finishing points can be determined 
on a chl Id-by-cht Idbasis, (The basal rule is 5 consecutive correct 
responses; the ceiling rule is 5 errors jri any 7 corisecutive responses.) 
This procedure assures a reasonable match between the difficulty of the 
test and the test-related capab[litles of the children. The procedure 
also avoids potential psychometric problems associated with out-bf-level 
testing. 

There are other advantages of the pIAT mode of administration. The 

lay-but is perceptually appealing, with large line drawings on glossy 

paper arid clear type, both features concentrating attent ion upon the ques- 
tion at hand. It is Impbsslble fbr children to skip an item accidentally; 
The PIAT is an untimed, power test, yet the procedure of establishing a 
critical range of items for each child al lovy/s the test to be giveri in 
approximately 10 minutes. Instructions, questibris, br directidris may be 
repeated either when requested by the child or when nb response is elicited. 
And, if children are working too quickl^y, the tester can attempt tb 
modify the tempo. Guessing Is encouraged. Rapport between tester and 
chi Id should be greater than in a group test because it can be establ I shed 
on a personal level, and the tester can attempt to motivate the child 



^From preliminary analysis of Sprlrig 1979 arialytic samples, PDC and 
comparison groups combined. 
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thrbUghi use of. praise and _encburagemeht . All of these aspects of the PIAT 
should help eliminate performance differences favoring programs that spend 
a large amount of instructional time in fostering test-taking skills; 
Finally^ the individually administered character of the PlAT makes possible 
nore detailed monitoring of the behavior of each child in the test situation 

The Metropolitan Achievement Test (MAT) emphasizes cdmprehens ipri in 
a way that results in little or ho curriculum bias andhigh face-validity. 
Items are wel 1 -const ructed , but the content is more relevant to middle- 
class children than to PDC children. Since the comprehension questions 
relate closely to the passages, the culture bias is not as severe as it 
otherwise might be, but it is there. One difficulty with the MAT, how- 
ever, is that the grade-appropriate tests appear to be too difficult; 
too little variance is anticipated to allow detecting small but real 
prdgram effects . Thus, it was recommended that the PRIMER level be used 
in the PDC evaluation at second grade (it was hormed for K.5 to 1.^) and 
that Pri mary 1 _ (' " 2) be used at third grade, although it was nbrmed for 
1.5 to 2.k (2.5 to 3.-^). Pilot testing of the MAT PRIMER was conducted 
with a subsample of first grade PDE children In 1979 to provide more 
guidance on the choice of level (and also to examine the relationship 
between reading recognition and reading comprehension scores). 

PIAT Mat henna t i cs . In our search ^br a test of mathematics achieve- 
ment, six standard commercial tests were given serious corisiderat ion. 
These included the California Achievement Test, Sequential Tests of_ 
Educational Progress, Comprehensive Tests of Basic Skills, Metropolitan 
Achievement Tests, Stanford Achievement Test and the PIAT. _ The following 
discussion explains why our review resulted in selection of the PIAT 
Matheniat i cs subtest for PDC. 

Four major criteria were considered: (1) whether the test in fact 
measures mathematics abilities (arid hot ^ for example , read ing or memory); 
(2) absence of bias toward a particular curriculum; (3) clear instructions 
that would tend to minimize the advantage. for test-wi se or test-trained 
students; {M) a minimum of cultural bias In the content of the items. 

The PIAT Mathematics subtest is rndividuany administered with a 
total of 8^ items. This, in combinatidh with characteristics of the 
fortTiat and items, gives It a number of advantages. Most Important Is 
the fact that reading ability is minimally confounded w|th mathematics 
achievement/ability. The separation of reading from mathematics is 
accomplished by having the tester read each question aloud. The child 
does hot see a representation of the question In print, although for 
some questions the child is shown either printed or pictorial represen- 
tations of key facts or directions (presumably to reduce the demands of 
maintaining the content of the question in memory). 



A distinctive feature of content covered by . the_ PI AT_Msth test is the 
emphasis upon a mix of problems that demand application of . frequently 
taught mathematical concepts (e.g.^ cbmputatlbh, quanti tativeaspects of 
currency and time, ordinal ity, cardinality, shape^ and specific terms 
such as "double," "fifths," "yo^^f^gest^" etc.[ In relatively universal 
situatibhs- Al though chil dren are not permi t ted to use pencil and papery 
the computations required are such that ;t seems reasonable to expect 
children to performthem mentally. The problems are const riicted so as 
to minimize the influence of previous experience with particular formats 
and content; 

The PIAT Math subtest was also used In the Home Start fol loW-up 
study. The following table compares data from the standardization sample, 
the Home Start study and the PDC evaluation: 



Grade Level 


Standardization 


Home 


start 


Fb 1 1 bw- Up 


PDC EvsXv 








SD 


Mean 


SD 


Alpfa 


Mean 


SD 


kindergarten 


13^1 


3;98 


u.^ 


4.0 


.83 


13.2 


3.95 


First Srade 


19-5 


6.32 


20. 1 


6.3 


.90 


18.7 


6.65 


Second Grade 


29.2 


8.11 


30. 1 


3:S 


.93 


Not Appl 


i cabl e 


third Grade 


37.5 


9;12 


Not 


Appl 


icabl e 


Not Appl 


i cable 



The publishers report dhe-month test-retest rel labi 1 [ties for math of .52 
for the kindergarten sample, .83 for first grade, and :68 for third grade. 
In the Home Start foUow-up study PIAJ Math scores correlated .70 wl th 
PIAT Reading Recognition scores; in PDC the two subtests correlated -53 
at kindergarten. 



MSCA--Verbal- F4uenc^ , The Verbal r1 uency_ subtest of . the McCarthy 
Scales of Children's Abilities (McCarthy, 1972) has been Included In the _ 
PDC battery from the beginning. It Is one of the few general developmental 
measures that we judge suitable for continuing to administer as the 
children become older. In a very brief period (five minutes orjess) an 
assessment of children's abi 1 ity_ tb_ recal 1 information in conceptaal 
categories is assessed. The chi Id. isasked to name as many members of 
the category as he or she can within 20 seconds. The categories are 
"animals," "things to eat," "people's names," and "toys." 



^From preliminary analysis of the Spring 1979 analytic samples, PDC and 
comparison groups combined. 
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in the first phase of the evalaation the test was administered at all 
grade levels to a sample of 24-27 chHdren at the Georgia site; data from 
that testing, along with data from the total PDC sample are as follows: 



Eross-grade total PDC English- 

Grade Level- . Data from Georgia — Pom i nan t S amp-l e^— 

Mean 'A Ipha Mean SD A Iph'a 

Head Start Not Appl icable 9-3 5-73 .76 

Kindergarten 1^.1 ,71 1^-3 5-79 -68 

First Grade l6.4 .75 16.2 6.05 

Second Grade 20.8 .79 Not Applicable 

Third Grade 21.8 .57 'i Not Applicable . 



Bi 1 ingual- Syntax Measure 4BSK^ . The BSM (Burt, Dulay, S Hernandez 
ChaveFj 1975) was also selected at the oucset of PDC. It represented a 
wel 1 -developed measure of syntactic development that was suitable for 
both Spanish- and EhgMsh-speaki h§ children. The BSM assesses chi 1 dren ' s 
oral proficiency with Engl i sh arrd/pr Span i sh gramrhatical structures^ using 
cartdbn-like pictures to elicit children's responses to the tester's 
questions. Simple questions, used with the colored cartoon pictures,, 
provide a conversational setting for eliciting speech. An_ana1ysis of the 
child's response yields a score that can range from 0 to 18. Responses 
are written down verbatim by the tester so that farther analyses can be 
carried out et a later time if desired. 

Al 1 chi ldren_have been admin Istered the BSM-English, and children who 
show facility In Spanjsh are administered the BSM-Spanish as well.. For 
the children who receive both versions, the order of administratibri 
controlled so that during any single testing period half the children 
receive the Spanish versior, first and half receive the English version 
f i rst . 

During the first phase of the PDC evaluation alpha coefficients at 
different time points ranged from .82 to .88 for tbr: ^pq i I sh-domjnant 
sample and from .7$ to .96 for the Spanish-dominant - idren. There may 
be some concern vvlth a eel lihg effect by thi rd grade; — ihe mean score at 
kindergarten was 11.93 on the_ BSM-Ehgl i sh for Engl i sh-domi nant children 
(SD = 3.09) and 13.13 on the BSM-Spanish for Span ish-dpmi hant children 
fSD = 2.^5)-^but a new edition of the test may be available for use at 



^From preHir^Inary analysis of the Spring i979 analytic samples, PDC and 
comparison groups combined. 



second and third grades. Ihterirri Report [X repdrted good s tab? 1 i ty across 
testing times (e.g., correlations df_.75 for the BSH-Ehg 1 i sh from. fall to 
spring' of the Read Start year and .61 from, fall Head Start to.sprihg 
kindergarten), so the BSM seems to be a likely candidate for demonstrating 
real long]tad;nal trends from Head Start through third grade for the PDG 
evaluat ion; 



Progress in school . To provide another perspective on school 
achievement it was decided to ask parents to judge the progress of thelr 
child during the parent interview. Question 11m on the f i rst-grade Parent 
interview asks the parent to rate whether their child "is learning a lot 
at schcor' on a scale from 1 (''definitely true") to 5 ("not at all true"). 

Special ed4ica^l<>a and— g-T^ e re ten tion - Two items typically kept ?n 
school _ records and usedih some educational evaluations are being documented 
for PDC ,_al though §uidelines for interpreting data f rom these records are 
not completely clear at this time. The extent to which a child is "held 
back" a grade may be a very gross indicator of the school 'i capacity to 
provide adequate educational programming for that child. This informa- 
tion will be collected so that the incidence of grade retention can be 
examined for possible program effects; A number of longitudinal studies 
of Head Start and other preschool programs (see Lazar , Hubbetl,Murr^ 
Roche, Z Royce, 1977) have found that early intervention reduces the extent 
to which children are retained In grade. 

Placing children in "special education" has also been an lnr!icator 
that the children are not succeeding In :>chool _ td_the extent expected of 
them. Since this has been a key Impact variable for some long I tud I rial 
studies (see Lazar, et al;, 1977)^ [t was decided to collect ^ information 
on it for the PDC evaluat ion- Unfortunately, special education placements 
have become a very different matter than they were the late 1550's and 
early 1970's. With the advent of PL 9^-1^2 and heightened awareness on 
the part of school personnel of the need to provide appropriate educational 
experiences for hand i capped _ chi 1 dreh , placement data per se will proyjde 
ambiguous i hfbrmat lori : a higher rate for PDC could mean cFlldren with 
special needs are being appropriately provided for or that the program has 
somehow "created" more children with special needs. At any rate, this 
information will be available for the PDC and comparison samples for use 
either as Impact data or as explanatory information. 

In Spring 1S79, testers at each site asked school personnel whether 
children in the '.Sample had been provided with an indivIdaaHzed education 
program (lEPj. If the answer was "yes," information was col 1 ected on the 
natL!re of the handicap and oh the extent of mainstreaming, using categories 
developed for a national evaluation of maihstreaming in Head Start (Walters, 
Vogei, Brandls, & Thouvenel le , 1978). 



Categories of handicapping cbndltlbhs are the fbl lowing: 

Hard of hearing 
Deaf 

Speech impaired 
Visually handicapped 
Blind 

Seriously emotionally disturbed 

Specific learning disability 

Orthopedl cal 1 y ' r^ipai red 

Other health impaired 

Mental ly retarded 

Mul t I -hand i capped 

Other 

The extent of ma i ns t ream! ng was classified as follows: 

Compjete ma I ns t reami ng Into a regular classroom^ 
with no supportive assistance 

Complete mainstreaming Into a regular classroom, 

_with supportive assistance provided by a specialist 

Complete mainstreaming In a classroom where the regular 
classroom teacher and a special education teacher coop- 
eratively work with all children in a team arrangement 

Reverse mainstreaming in which hph-hand i capped children 
become part of a special education class _ 

Partial mainstreaming where hand I capped _ ch i Id is In a 
special education class Bat goes to malnstreamed classes 
fw- • more regular classroom activities 

H - -^hlld Is not malnstreamed and spends the 

^: ': ".^ Cay In special education classes 

Keasores of Social -Embtibhal Develbpmeht 

The six constructs within the boclal-emptional domain are assessed 
by four Instruments: one test (P|PSh a child interview, a teacher 
rating scale (CRS) and a tester rating scale (PDCL) . 

Social problem-sol-v-ing- . The Preschool Interpersonal Problem-Solving 
Test (PIPS) (Shure S Sp' :ack, 197^) was selected for use at the beginning 
of the PDC evaluation arid has rema ined an Important part of the battery at 
each testing period. The PIPS assesses the child^s abl i I ty to generate^ . 
alternative solutions to the. problem of obtaining a toy from another chl Id. 
Seven different toys are depicted and used as the basis for the problem. 
For example: 



"Johnny has been playing with this truck fbr_a long time 
and Jimmy wants a chance to play^with it. But Johnny 
iceeps on playing with it. Jimmy v;ants to play with the 
truck. What can he do to get a chance to P^ay with the 
truck?'' 

Testers probe to elicit as many different types of solutions as possible 
to the seven problem situations. Thus vfar the P I PS has been scored for 
the number of di f fererit_sbrutions of fered by the child^ so that the range 
of scores is only 0 to 7, since there are seven opportunities to offer 
new solutions. 



The solutions offered by the chi Id are coded according to clearly 
defined rules. First, each response is coded as c» '^'solution" or a "non- 
solution." There are 25 solution categories and 3 non-solution categories. 

There is some concern that the test sample may be approaching a ceiling 
given the current scoring system, since in the Home_Start follow-up study 
kindergarten, first-grade and second-grade groups _a] 1 _ averaged around §.3 
different solutions (with x standard deviations of 1.6). Thus far in PDC, 
PjPS scores are increas[ng appropriately wi th age. The mean scores at 
entering Head Start, spring Head Start and spring kindergarten children 
were 2.1, 2.7 and"3.8, respectively- 
One possibility for i ncreas i ng che sens 1 1 i vi ty of the PiPS to the 
social problem-solving strategies of blderchi Idreri would be to develop 
scores for different types of sbTutibhs. Among the 15 solution categories, 
there appear to be ones that are conceptual ly_ related. Using Spring 1979 
data, procedures will be explored for categorizing the solutions into groups 
with children receiving a score for the number (or _proporti>-») of solutions 
offered in each group. One possible grouping is: (1) prosocial solutions, 
e.g., ask, say please, share; (2) xrade/swap solucions, ^-9 
bribe; (3) man i pu lat ive/decept i ve solut ions , e.g., trick, fi^nagle, manipu- 
late^ (^) anger; (S) passive solutions , e.g. , wait , plan for future; and 
(f) aggressive sbiUtions, e.g., grab, physical attack. 

The PIPS authors claim that their measure is relatively Unconfounded 
with general abLlIty beyond some minimum necessarytb understand the task. 
PDC data conf i riP! h i s . Although factor analysis of the kindergarten data 
showed that PIPS loaded on a factor that included measures of verbal 
fluency and verbal memory, indicating a strong verbal component to the 
test, its bivarlate correlations with those measures were only moderate 
(e.g., -27 between PIPS and Verbal Fluency) and PIPS scores correlated 
very si ightl ywi th other measures (e.g.,^08 with BSM-Engl ish, . 12 with 
PIAl ReadingJRecognitibn and .10 with PIAT Mathematics). The Pj PS does 

not lend J ts^l f to eslt imates _bf [hterrial consjstency reliability and 

PDC dsta indicate low stability from one testing time to another compared 
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with the stabijity of other measures In the battery: the fal 1 -to-spr Ing 
correlation for the Head Start year was.^l and the correlation on P!PS 
scores f rom ^fal 1' Head Start to spring kindergarten. was .20. A more sensi- 
tive scoring procedure might also improve the stability of the measure. 

Attitude- tow a rd teacher . A child's attitude toward hi^s or her teacher- 
is seen by many a ah Important aspect of successful performance^ Without 
debating whether this attitude may be one of the causes of higher achieve- 
ment level's or one of the effects, many . program operators would be pleased 
to note improvements ih children's atti tudes .toward _ their teachers. The 
Purdue Social Attitude Scales, developed by Cicirelli (19 ) contains a 
scale labeled "attitude toward school'^ in which children are shown cartoon- 
story items. Since a stick-figure representing a teacher pjays a prominent 
role in most of the items, we have chosen to label the scale, "attitude 
toward teacher.'' 

For each item, ihe mafn character (given the child's name by the „c:-r:e; 
is about to be engaged in some activity or is pboUt to have something hs /pen 
to him or her: For example: * / 

(child's name) is working at school: 



teacher conges over. She looks at 's work. 

Which one is the teacher's face?" 

Jh^ child responds to each item by pointing to one of five faces, which rang 
in expression from very happy to. very sad. The child 's score is fhe mean 
"rating" given to the ten Items. In designing the PDC batte^ for Spring 
1979,8 of 10 Items were Incbrporated as Part 1 of an instrument called the 
Child Interview; Part 2 of the eh[ld Interview-^- 1 terns assessing the child's 
attitudes toward readihg--l5 described in the.sect-oh on learning attitudes. 

The "attitude toward teather" items 'adm[n istered for.the first 

time in PDC in Spring 1979' but had been i.jinis'tered as part of the total ^ 
Purdue Social Attitude Scale in t-He Home Start fol low-up study . _:l;n that 
evaluation, relatively high_ Internal consistericy was found for the enti re 
set of 3d items (alpha = .87 at first grade); however , the ttiternaU cons Is- 
tency for the 19 item set, from whlch_the.8 Items^of the PDC Chi Id Interview 
were drawn, was considerably lower (alpha = .67). Counterbalancing that 
finding were other factors: First, Home S:tart data Indicated that Purdue 
Social Attitude Scale score was not confounded with age--grbup means did not 
differ significantly from kindergarten through second grades. - S.econd, 
obviously better measures of young children's attlt-udes toward schcbT were 
not available when instrument, select ion decisions had to-be made. 
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Child Rat [rig Scale (CRS) . Three social -emot fonal constructs have Been 
.Assessed iri PDC v^ith the Child Rat i ng Sea 1 ie (a fourth scale of the CRS, 
jcademic motivation, was added in 1979; it is discussed under "learning 
attitudes." The CRS was originally developed \n the first year of PDC 
to assess children's behavidr In two areas of "social competence": inter- 
personal competence and task competence. Thirty-nine statements (e.g., 
cooperates and shares with others; shows self-confidence) v.'ere developed^ 
relying heavily on the Bronson General Competence Rating Scale (Bronson, 
1573). The statements are listed on a response sheet and teachers are 
asked to rate each child on each item using a five-point 5cale (l = r^jrely; 
5 = very frequently). 

Prior to Spring 1979 data collection it was decided to refine the 
Child Rating Scale so as to reduce the number of items (thereby reducing 
the burden on teachers) and to add a scale to assess academic motivation. 
Using factor analysis and regression procedures (as described fully In 
Interim Report IX), the original 39 Iterrs were reduced to 1/ which possessed 
a stable, factor structure of three sca'es, each with an Internal consis- 
tency reliability exceed i hg . 75 . The three scales have been labeled 
"self-assurance," 'aggressiveness," arid "dependence." An examination of 
the aggressiveness scale items, however, suggests thatthe scale may confound 
prc-social and antl-soclal aggression, so the possibility of separating 
these into two scales is being examined. 

Sociabi 1 i ty . A rat'ng scale comp;<?ted by testers wa? originally 

developed by High/Scope use in the Home Start Evaluat iop- (Deloria, 

Love, Gordon, Hahvey, Hockman, Piatt, Nauta S Springer. 197^). This scaje, 
the Pupil ObservatlorT Checklist (POCL)_had its roots in a rongery 25-item 
scale developed by High/Scope for use in Its P^oilo' "through eval uat ion work. 
Tne lO-it^'- version used in the Hone Sta rt . eva 1 oat I on and the s Is^htly 
--odified ]l-iter version used at each testing time In PDC have consistently 
yielded two stable, hlqhiv reliable factors. One seal e , . "soc I ab i ! : ty , . 
is classified here as a con^.trL!ct within the socIa|-emot Icnal dorr.'-.. _The 
^ecor^d scale, "tc^sk orientation," will be discussed under the ciomai.' of 

; '^P:-^ : 3 t t ' t udcs . 

^-c ^OCh c^-^sists of n 7-point rating items which are coftipleted by the 
• ^ : ; - * a^t^'?' t^e testing session v;ith each child; The socia- 

M ; - ;■ -1 0 : c cn - " ■£ ■ ^ o ^ the f o 11 ow 1 n c bipolar adject! ves : 

Shy-soc I sb ! e 
C;J i ^ t - 1; ci ] ka t i ve 
"-"Ssiv^- - active 
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Measures of Learning Attitudes 

Learn ?hq attitudes have assumed increasing Importance among educators. 
Several cbhstrijcts related to. this general domain have been Identified for 
neasurement_ I n PDC, and a variety of methods are being used to obtain the 
measures- The six constructs listed In Figure 2 are obtained from five 
different procedures^ a ch[ld Interview, a teacher rating, a tester rating, 
a parent rating and school records; 

Att I tude toward read Ihg , Part II of the Child Interview consists of 
an Informal discussion between the tester and child in which thetester 
asks the child a number of questions. In a conversational manner (e.g., 
"Do you like story books?" "Do you like to read stories to other people?" 
"When do ybu most like to read?" "What Is your favorite story book?"). 
After the conversation Is finished the tester completes six ratings, each 
on a scale from 1 to 5: 



I. Child rarely reads at school. Child reads a lot in school 



2. Child rarely reads outside 
of school . 

3- Child reads only what he/sH? 
has to read; does not read 
for pleasure or for own 
Information. ■ 

h. Reading is perceived only 
as <^ school activity. 

5. There Is little or no 
variety in the reading 
materials used In school. 

6. There Is little or no 
variety In the reading 
materials used outside of 
schdo 1 , 



ehlid reads a lot outside of 
school . 

Child reads a great deal on 
own inl_t iat[ve for pi easure 
and for Information: 

Child perceives reading as an 
Important activity outside of 
school al so; 

Considerable variety In school 
reading, e.q. , readers, stories, 
I Ibrary nate-'ials . 

Considerable variety in reading 
materials used outside of ool , 
e,g,, stories, newspapers ters, 
magaz I nes . 



This procedure was adapted from a process used by the High/Scope Follow 
Throuah evaluation In 1976-77 (Kittel, Tamor, Smith S Bond. 1977)- After 
expe r I rnen t i hg with a more structured quest Ion I rig approach, the currerit 



rnet nod 



gui^ded uristructured disc 



usslori fdllovvfed by tester ratirigs was 



adopted. Using t he _ ques t i pns as aguide, the interviewer Is free to probe 
and explore the topics with each child until there Is enough Information 
to complete the ratings. 
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Scales one and five describe, from the child's perspective, how much 
time is soerit reading In school arid what variety of readtrig occurs iri 
school. Scale six _iridicates what variety of readirtg materials are preserit 
arid what variety of reading activity occurs in the home. These three scales 
appear to be measures of context rather than Impact. Consequently, they 
are not considered in evaluating child outcomes. 

The three remaining scales --two, three, and foui — were formed to Be 
highly ! ntercorrelated (coefficient + alpha = .9^) snd were summed to form 
a cdmpbrierit variable reflecting children's "interest in reading." 

Academic motivation . As mentioned earlier, three Items were added 
to the Child Rating Scale in an attempt to assess this construct. Several 
recent studies have emphasized the importance of this variable. In the 
Perry Preschool long! tudina! study, for example, two teacher rating scales 
were found to correlate fairly htgr"!v with measured school achievements. 
One was the "acadetiic notivatlon'' scale of the Pupil Behavior Inventory 
(developed by Vlnter , Sarri , Vorwai ler , Schafer, I966) and the other was 
an "academic poteritial" scale from the Yps? larit I Rating Scale. This 
dimerislon has also beeri emphasized in the work of Bloom (197S; arid Cross 
(1978). The academic motivation factor of the Pupil Behav for I hveritory 
originally contained nine Items; ratings on that factor _ correlated from 
.^9 to .71 with concurrent scores on the California Achievement Test at 
grades 1, 2, and 3 (We[kart,Bond^ McNeil ^ 197B). Three Items from the 
Pupil Behavior Inventory were selected for PDC: 

Is motivated toward acade'^Mc performance 

Completes assigriments 

Is a'lert and interested In school work 



Tdsk orientation- . Eight items from nnc Pcp\] Observation Checklist, 
described above, comprise a "task orlentst :on-- scale. As with the 
sdclabillty scale, this measure has remained a stable and reliable 
inaex across the PDC testing times. The eight bipolar I terras , rated by 
the tester on a 7"pbirit scale, are as follows: 

Res i St i ve-cooperat i ve 
I nd i f ferent- 1 nvo 1 ved 
Easily distracted-attentive 
Nervous-relaxed 
Needs u r-g I ng-qu I ck to respond 
Prefers easy task-^^-attempts difficult tasKs 
Gives Up easily-keeps trying 
Needs reassurance , pra i se , encouragement - 
rea 1 is t i ca H y sel f-cbrif ' den t 
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Att ? tu toward schbbi arid .engagement in school ^rel ated work-a^t- 
hdn.e. During 'the Parent Interview^ developed for adrtiirilsterlng the first 
t imtr in Spring 1979 (see Section II of this appendix), the. parerit is 
asked several questions that are designed to tap two possibly distinct 
aspects of learning attitudes. The first, a general attitude toward 
school, consists of fcur items: The first two are statements read, to 
the parerit to which he or she responds by indicating whether each is 
"definitely true" to "not at all true" a:ong a 5-point scale. The 
questions are: 

_(chi Id * s name) loves school and enjoys belrig there 
feels that he/she Is learning a let In school 

The third item Is a question which asks (if there are books or r^agazines 
in the home) whether the child usually asks someone, to read with him/her 
or whether someone usually offers to read to the child (on the assumption 
that a child with a more positive attitude toward a school activity such 
as reading wl i 1 be more likely to take the initiative In seeking to read 
vvith someone else). The fourth item asks whether the chl id vol^untari ly 
does homework r>- If he/she had to be prodded Into doing It (after the 
Interviewer ^ . lains that the child actually has homework assignments). 

The second scale, "engagement i n school -re lated work at home" was 
adopted because of concern that school ach ievement measured crily in the 
school setting might not capture program effects that more thdrdUghly 
permeate a child's life; In High/Scope's Fol low Through evaluatlori, 
It '--as discovered that even when differences were jOt found between 
Follow Through arid comparison children on the standard achl ^vement measures, 
Fol low Through children were more 1 Ikely to engage in activities at home 
that vjere related to their school work (Bond, Smith S Ki t te] , 1 976) - In 

programs like PDC and Follow Through, with the i r emphas I s on parent 

participation in children's 1 ea rn i ng , _th I s variable cari be an important 
i-dicator of the program's success. The specific q'^estloris err^p^oyed in 
the PDC Parent interview are the following: 

Not couritirig reading he/she has to do for school , how often 
does ( chi Id ) look at a book or magazine at home? Would you 
say: 

every day? 

several times a week? 
about once a week? 
2 or 3 times a month? or 
once a month or ^ess? 
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Not counting homework, does ( chi Id) ever do things like 
writing or drawing that he/she learned at school? 

yes, often 

yes, sometimes 

no 

Attenda oce : School attendance has frequently been cited as a 
possible indicator of general attitudes of the child toward school. We 
:-ecogni2e that the interpretation of such data, however, is ambiguous. 
But, combined with other i hf orrnat ion , sjuch Information might provide 
additional insights into the influence of PDC programs on children. 

Measures on Health and Nutrition 

One of the most difficult areas to asspts in a large-scale evaluation 
is the physical status of children. Fine-grained medical and nutritional 
assessments are too expshsive and time-consuming to be feasible, and yet 
the provis[oh of health and nutritional services is one of the critical 
features_bf Head_Star progrjmsand figures prdrriihantly in the PDC guide- 
lines. For the PDC evaluation it was decided to (ij obtain direct measures 
by measuring height arrd weight, recognizing that this wou Id _ prov i de ah 
assessment of only extreme departures from normal growth; (2) bbtaindata 
at the program level on the provision of hsalth and nutritional services, 
assuming that if ' "le del ivery of services can be documented one can assume 

improved status on the part of children receiving the services; and (3) 

explore the f eas i bi 1 I ty of assessing the impact of the program on children's 
knbwiedge.bf good health and hutritlohal practices. As of Spring 1979, 
only the first of these procedures has been fully implemented. 

Height and Weigh :. Each spring, High/Scope tisters measure the 
children's height ar.d weight using a standard procedure. Weight is measured 
on balance beam scales, usually borrowed frci:- the school. A standard 10- 
pound weight Is placed on the scale by the tester before weighing the 
children in order to check the calibration. Children were asked to remove 
thel' shoes and any outdoor clothing, such as jackets, before being weighed. 
Height Is measured by having the child stand straight against a wall. The 
^-iab*es usee. In the analysis are (]) height for age, which is a good 
-"r^x of ch'onic protein undernutrition and (2) weight for height, an Index 
of more acL'te changes in nu: ilional s'catus- 
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Measures of— CJ 



Froinri the outset, the PDC evaluation has been concerned with the 
problem of Inferring social -emot ibha] variables from data collected in 
test-like sett ings and so_a child-oriented bbservat Ion system was developed 
and used from 1975 to 1978. Unfortunately, tne costs involved. In _ 
obtaining data that would be reliable at the individual child level became 
too prohibitive, and the Information yield too ambiguous, for the procedure 

to be continued. In designing the second phase of the evaluation, ]t 

became clear that the evaluation needed to provide ACYF with more informa- 
tion bri prbgram implemeritat Ibri at the classrbbm level . Therefore, a new 
bbservat Ibnsystem was developed tb describe PDC and comparison class- 
rooms (see Section IV bf this Appendix fbr a full descripticrO - Although 
the focus of that system Is on program implementat jon, the observations 
necessarily Involve children on a number bf dimensions. Thus, to the 
extent that It is feasible given the response frequencies of the variables 
of interest, observation data can he analyzed at the classroom level to 
provide additional information about the influence of PDC on chMdren^s 
behavi br . 

The observation system Incl ude5_seveh variables that may be useful 
for this aspect of the evaluation- These are_ listed here^ but the reader 
is referred to the PDC Classroom Observation System Manual (Diambrids tone, 
Smith, & Rosario, 1979) for a more detailed explanatlbn: 



Child initiated interactions with teacher 
Children's attention to learning activities 
Children's respect for parents in the classroom 
Level of classroom disruption 
Noise level 

Respect fbr teacher and a'de 
Cooperation with teacher 




References 



Aridersbn, S., S Messick, S. Social cbmpetehcy ih young children. 
De ve 1 opmen£a 1 Psycho 1 ogy , 197^, VC 282-293- 



Bache, W. , & Naata, M: d. Home Start Follow-ap Study: A study of 
long-term Impact of Kome Start on program participants. Final 
Report to ACYF. Cambridge, MA: Abt Associates, Inc., 1979- 

Bloom, B- S- Human characteristics and school learning , New York: 
McGraw-RI 1 1 , 1975. 

Bond, T. , Smith, A. G., S Kittel, J. M, Evaluation of curriculum 
implementation and child outcomes, f^sport to Office of Educa- 
tion, Project Fol low Through . High/Scope Educational Research 
Fdundatidn, 1976. 

Bronson, H, Manual for executi ve arid social rklll profile f^— p-re^ 
school chl Idren . . narnbridge, MA: Harvard University, Graduate 
School of Education, 1973. 

Bort, M;, Dulay, H., & Hernandez-ehavez , E. Bilingual Syntax Measure . 
New York: Harcourt, Brace, dovanovlch, 1975- 



Cicsrelli, V. The Purdue-Soc^UJ- Attitu d es Scale s^ . West tafayette, 
Indiana: Purdue University, ri.d- 

Deloria, B. , bove, J . M. ,. Gordon , S. , Hanvey, R,,_ Hbckman, E^, Piatt, 
J., Nauta, M., & Springer, N. The National Home Start Evaluation 
Interim Report V: Summative Evalaatlon Results, Report to ACYp. 
Ypsilanti, Ml: High/Scope Edacational Research Fbundatlcn, 197^- 



DIamondstone, J. , Rosario, J. , S Smith, A. G. Project Developmental 
Cdntinuity Classroom Observation System. Ypsilanti, Ml: High/ 
Scope Educational Research Fduridatlbri, 1979- 

Dunn, L. M., & Markwardt, F. C. , Jr. Manual for the Peabddy \n<UvVdu^ 
Achievement Test . Circle Pines, MN: American Guidance Service, 
1970. 

Kittel, J. M., Tamor, L., Sn'th, A. G., Bona, d. T. Evciaatioh of 
curriculum implement. ^ -on and it^ effects on ch 1 1 dren ' s wr I cten 
and oral 1 ariguage, and an exploratory study of post-treatment 
effects iri LeFlore Courity , Mi ss i ss * Dpi . Report to Office of 
Education, rrojerr Follow Throutjh. Hiah/Scope Educational 
Research F ..j^ ;^at ion . 

Lazar^ L , Habbell, R. , Murray. R. , Rbsche, M. , &_Rbyce, J. The 
persistence of preschool effects: A long-term fbllbw-up of 
fourteen infant and preschool experi;"ents. Report to ACYF. 
Ithaca, NY: Cornell University, 1977; 



A-22 li^ 



McCarthy, D. McCarthy Scajes of Children's Abilities: Manual , New 
York: Psychological Cbrpbratibh, 1S72- 

Ogilvie, D. , & Shapiro, B, Manual for assessing social abilities 
of one to six year bid children. in B. L. White t J. 6, Watts 
(Eds.), Experlejoce and environment: Major influences on the 
development of the young child : Englewood Cliffs, NJ : 
Prentice-Hal 1 , I969. 

Raizeh, S,^ & Bob row, S, B. Design for a riatibrial evaluation of 
social competence in Head Start children , Santa Monica, CA: 
Rand Corporat ion , 197^. 

Shure, B, , & Spivack, The-PlPS les^Hanoat , Philadelphia: 

Hahneman Medical Collego"^ 1 97^^ 

Vinter, R. p. , Sarrl, R. C. , Vbrwa 1 1 er , D . J . , Z Schaefer, W.E. 

Pupil Behavib r" 1 nventbry : A manual of admi n ' s t ra t ibri arid scoring 
Ann Arbor, Ml: Campus Publishers, I966. 

Walters, P. B., Vogel , R. J., Brandis, M. R., & Thouvenelle, S. 

Evaluation of the process of ma i ns t reami ng handicapped children 
Into project Head Start; Report to ACYF. Sliver Spring, MD: 
Applied Management Sciences. 1g78: 

Weikart, D. P,,_Bbnd, J. T. , 5 McNeil, J. The YpsilantI Perry 

Preschool Project: Preschbbl years a.. d 1 bng i tud i na < "^^^ ■ 
through fourth grade. Monographs bf the H < eh/'^^^ ppe Edur.- 1 i 0'ia 1 
Research Foundation , No. 3, 1978- 

White, B: t: , & Watts, J. C. (-:ds.)^ Exper ;^ ■ . J.^^^-^liLrSilltlTJ. 

M ajor ■■■Lrii lluences on ^h^ devel opm enf ^Z_ _rbv-_ •i.-i-r.c cj\;jj^> tr.o, ' cvj- 
Cliffs, MJ: Prentlce-Hai 1 , 1973: 



APPENDIX B 

ebmparlsbn of Summary Score Dlstri bUtiorjs_by Treatment Group, 
ehild Outcome Measures for Spring 1979 (Grade l) 
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Figure 1 

CornjDarisbri df Summary Score blstrlbutions fc5r PDC and Comparison 
Children oh the Spring 1979 BSM-English 
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Distributions significantly different: = 19-97, 9 d:f:; p = .013 

Score levels at which significant differences occ- 
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Figare 2 

Cbmparisbh bf_Surnmary Score bistrifautions for PDG and Cbmpar 
Children on the Spring 1979 BSM-Sp?inish 
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not significantly different between groups. 
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Figure 3 

Cdmparl son. of Summary Score Oistribut jons for PDC and Comparison 
Children oh the Spring 1979 MSCA Verbal Fluency 
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Comparison of Sa.-nrnary Score Distributions for PDC and Compsrison 
Children cn the Spring 1979 P'AT-HDthematics 
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Gomparisbn of Summary Score' Distributiohs fbr.PDC. jhd Cbmparisbh 
Children oh the Spring 1979 PIAT-Reading 
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Distributions significantly different: = 16,7^> 8 d.f.; p = 0 
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r" • of Sanmary Score Di st r i but !bris for PDC arid Cbtnpari son 
.:M -en on the Spring 1979 POCL 1 "Task Orientation" 
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Figure 8 



Comparison oF Summary Score Distributions for PbC and Comparison 
Children on the Spring 1979 POCL 2 ^'Sociability" 



MIIiPDINT 



3 i £i B @ f} 
S, 00 00 
'3- 0 00 0 
1£. OOy 

IS- 060 
£ 1 . 0 0 0 



13. 1 
£1-2 

14.7 
£0. S 



PDC (h=25'9) 



•3 

17" + X X X X X X K X 

34 X X K 5"% X X X X X X 1^=1 X X X H X 

55 +XXXXXXXXXXXXXXXXX 

5S +xxxxxxxxxxxxxxxxxxxxxxx^ 

33 +XXXXXXXXXXXXXXXXXXX 

54 +XXXXXXXXXXXXXXXXXXXXXXXXXXX 



IMTEPVRL MIIiTH= 



OOO0> 



MIDPOINT 


hiNTV 




3, 660 0 




1 


6. 000 0 




15 


9, 0000 




21 


12. 000 




5b 


15- 000 


ife! i 


41 


19. 000 


£6.4 


£7 


2 i . 0 0 0 


£ n . 9 


cr--. 



Compar ! son (n=254) 
1 +X 



■rEFiGH X= 



-xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 
-xxxxxxxxxxxxxxxxxxxxxxxxxxx 



ar' -^'VRL i»iIDTR= 3.nnijn> 



Distributions significantly different: = 15.10, 6 d.f;; p = -020 
Score lev/els at which significant differences dccur^ : 



Mi dpd i ht 
18 



Raw Score 
3e 



Range in s.d. 

Units From 
Overal 1 Mean 



17 - 19 
(16.5 - 19.5) 



+0.33 to +0.98 
^Differences at p ^.10 by Goodman^s intervals test. 



Di rect ion of 
Rel ati ve Freqgencies 

Comparison > PDC 



B-8 



Cdmparisbri.cjf Summary Score Distributions fdr.PDC and Gomparison 
Children oh the Sprihg 1975 CRS-1 "Self-Assurance" 
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eomparisdn of Summary Score Distribytibris for PDCahd Comparison 
Children on the Spring 1979 CRS-2 '^Aggressi vehess** 
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Comparfsdh of Summary Score Distributions for PDE and Comparison 
Children on the Spring 1979 eRS-3 '^Dependence*' 
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Figure 12 

ebmparison of Summary Score DSstr ibatjohs for PDC and Cbmparfsbh 
Ghiidren on the Spring 1979 GRS^^f ^'Academic Motivation" 
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15, 0 00 



hist:^: 
15. g 

34.4 
15.4 
13. 0 
13.4 



•:;ehch X= 



in 



33 +:x;xk:x;::<xj<;>::kxk 

33 +KK>?^?^Ky>=:xK>=: 

34 +XHHX>i>iy.XK7<:^>i 



'.JHTERVRL l..:liriTH= g.e'LiOfO 



Distributions not significantly different between groups. 



ERIC 



Figure 13 

Cbmparisbri of Sumrnary Score DIstribdtlons for PDC and eomparison 
Children on the Spring 1979 Cl-1 ''Attitude Towarci Teacher'' 



PDC (n=279) 



MIDPDIMT HISJV '::EI=iCH X= 4> 

i.pnuu iij.a .3u : 

£. 0000 4S - 0 1 54 +XXXXXXXXXX>^XXXXXXXXXXXXXXXXXXXXXXX 

5.00 00 35.5 99 +XXXXXXXXXXXXXXXXXXXXXXXXX 

4. 0000 5.4 15 +XXXX 

5.0000 .4 1 +X 

<IhTERVf=fL l.iIDTH= 1-OOOV'> 



Comparison (n=265) 

MIIiPOIHt ' HISTv 'EhCH X= 3:.' 

1.000 0 12.1 32 +XXXXXXXXXXX 

£. 0000 4c:. 6 113 +XXXXXXXXXXXXXXXXXXKXXXXXXXXXXXXXXXXXXX 

3- 0000 41.9 111 +xxxvxxxxxxxxxxxxxxxxx>^xxxxxxxxxxxxxxx 

4. 00 0 0 3.4 9 +XXX 

5 • 0 0 0 0 0 . 0 + 

aNTERVRL I.1TDTH= 1. Onon> 



Distributions not significantly different between groups. 



2}j 

B-13 



Figure l4 



Gomparisbri of Summary . Score p: stribut ibris for PDC and Comparison 
efilldren dri the Spring 197? CI -2 "Interest iri Reading" 



PDC Cn=272) 



niDPCINT HIST': '-.ERCH :<~ £> 

'^.i-M-ifin 5;1 14 +XM:nXXXX 

? ft R h i\ 1 ;-: . £ 36 +:x::<:nXXKXxxxxxxxx?=; Js!^^ 

•q'nnnn 7^ +X^^XXJ^XXXXXXXXXXXXXXXXXXKXXXXXKXXXXXXXX 

ih'finS it -A 4? +XXXXXXXXXXXXXXXXXXXXXXXX 

12 i-iiin ;=•!.? ^•■'-^ +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

l^iouO 7.7 £1 +XXXXXXXXXXX 

•arHTERVRh i:..iiIiTH= a.nunu.. 



Cbmparisbn fn=2S7) 
r-IIlDPOINT HIST": ^EFlCH X= & 

;5. eaea £.£ it +xxxxxkxx 

5. 00 on 5.1 13 +XXXXXXX 



eOOe 16.7 43 +XXXXXXXXXXXXXXXXXXXXXX 

•3. norm £•£.£ 57 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

il.finn 15.6 40 +XXXXXXXXXXXXXXXXXXXX 

l:^.n-:n £3.3 60 +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

.tS.Of'n 10.9 £8 +XXKXXXXXXXXXXX 



■ IMTERVRL i.iIIiTR= £. OOniji 



bistribotlons not significantly different between groups. 
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